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(54) Recording medium, apparatus and method of recording data on the same, and apparatus 
; and method of reproducing data from the recording medium 



(57) In an apparatus' and method of reproducing a 
data unit consisting of a stream of packs of main picture 
data, a data unit consisting of a stream of packs of audio 
data, and a data unit consisting of a stream of packs of 
sub-picture data, which recorded on an optical disk (1 0) 
arid which are reproducible in the same time slot, repro- 
duction data of the data unit including the sub-picture 
data is reproduced is reproduced by a sub-picture 
decoder section (62) after reproduction data of the data 



unit induding the audio data and reproduction data of 
the data unit including the video data are simultane- 
ously reproduced by a video decoder section (58) and 
an audio decoder section (60), and after the reproduc- 
tion data of the data unit including the sub-picture, the 
reproduction data of the data unit including the audio 
data and the reproduction data of the data unit including 
the video data are simultaneously reproduced again. 
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Description 

The present invention relates to a recording 
medium, such as an optical disk, for recording com- 
pressed moving picture data, audio data and the like or 
different kinds of data, an apparatus and method of 
recording data on this recording medium, and an appa- 
ratus and method of reproducing data from the same. 

Recently, optical disk players, which can handle 
moving pictures and play optical disks on which picture 
and audio data are digitally recorded, have been devel- 
oped, and are widely used as players for movie soft- 
ware, karaoke and so forth. Further, MPEG (Moving 
Picture Image Coding Expert Group) standards have 
recently become international standards for a data com- 
pression system for moving pictures. This MPEG sys- 
tem performs variable length compression of picture 
data. j . 

The MPEG2 system is now also being Internation- 
ally standardized, so that the system format which 
matches with the MPEG compression system is def ined 
as an MPEG2 system layer. This MPEG2 system layer 
defines the setting of a transfer start time and a play- 
back start time, expressed by using a reference time, in 
moving picture data, audio data and other data, so that 
those data can be transferred and reproduced synchro- 
nously Playback is normally executed using those infor- 
mation. | 

As optical disks designed for multifarious uses have 
recently become available, it is not sufficient to consider 
only on the synchronism among individual pieces of 
data. 

For educational purposes, such as learning lan- 
guages, for example, main picture data as video data 
may present questions to users, While sub-picture data 
such as superimposition may give answers to the users. 
In this case, it is significant to show answers after make 
questions. 

Accordingly, it is a primary jobject of the present 
invention to provide a recording medium on which vari- 
ous types of data, such as main picture data, audio data 
and sub-picture data, constructed In a reproducible 
manner, are recorded in such a way that the sub-picture 
data can be reproduced with a predetermined I time 
delay with respect to the main picture data. 

It is a secondary object of the present invention to 
provide a method and apparatus of reproducing data 
from a recording medium on which various types of 
data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a reproducible manner, are 
recorded in such a way that the sub-picture data can be 
reproduced with a I predetermined time delay: with 
respect to the main picture data. | ! 

It is a third otyect of the present invention to provide 
a method and apparatus of recording various types of 
data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a reproducible manner, in such 
a way that the sub-picture data can be reproduced with 



a predetermined time delay with respect to the main pic- 
ture data. 

It is a fourth object of the present invention to pro- 
vide a method and apparatus of reproducing various 

5 types of data, such as main p'cture data, audio data and 
sub-picture data, constructed in a synchronously repro- 
ducible manner, in such a way that the sub-picture data 
can be reproduced with a predetermined time delay, 
preset in a machine, with respect to the main picture 

to data. 

It is a fifth object of the present invention to provide 
a method and apparatus of reproducing various types of 
data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a synchronously reproducWe 
F5 manner, in such a way that the sUb-picture data is repro- 
duced with a delay time arbitrarily set using a menu 
6creen. with respect to the main picture data. 

It is a sixth object of the present invention to provide 
a method and apparatus of reproducing various types of 
20 data, such as main picture data, audio data and sub-pic- 
ture data, constructed in a synchronously reproducible 
manner, in such a way that the sib-picture data is repro- 
duced with a delay time, computed from the difference 
between the display start time given in sub-pkrture data 
25 for one still picture, and the display end time, with 
respect to the main picture data. 

ft is a seventh object of the present invention to pro- 
vide a method and apparatus of displaying pictues in 
such a way that at the time of reproducing superimposi- 
30 tion data or the like as sub-picture data with an arbitrary 
time delay, with respect to main picture data belonging 
to various types of data, such as main picture data, 
audio data and sub-picture data, constructed in a repro- 
ducible manner, the superimposition data or the Eke 
35 appears as if hidden by a mosaic or filling with black dur- 
ing the delay period 

To achieve the above object, the presert invention 
provides a recording medium comprising a recording 
: medium comprising a plurality of data units recorded 
40 thereon, which become objects to be reproduced in a 
time sequential manner, each object being reproduced 
within a given time period; each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
45 packets of reproduction data including at least one of 
audio data, video data and sub-picture data; the time 
information of that data unit which indudes a sub-pic- 
ture being later by a predetermined time than time infor- 
mation of that data unit which indudes audo data or 
so video data; reproduction data of the data unit including 
tha sub-picture being reproduced after reproduction of 
reproduction data of the data unit inducing the audio 
data or video data. 

The present invention also provides a recording 
55 apparatus comprising a recording apparatus for record- 
ing reproduction data on a recording medium, compris- 
ing: means for generating a plurality d data packs and 
playback time information, the data packs containing 
packets of reproduction data indudng at least one of 
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audio data, video data and sub-picture data; means for 
preparing a plurality of data units including playback 
time information and having a stream of data packs to 
be reproduced within a given time period as a unit; and • 
means for recording the data units on the recording s 
medium in a time-sequentially reproducible manner, 
time information of that data unit which includes a sub- 
picture to be reproduced within the given time period 
being later by a predetermined time than time informa- 
tion of that data unit which Includes audio data or video 10 
data to be reproduced within the given time period. 

= The present invention further provides a method 
comprising a method of recording reproduction data on 
a recording medium, comprising the steps of: generat- 
: ing a plurality of data packs containing packets of repro- is 
duction data including at least one of audio data, video 
data and sub-picture data; preparing a plurality of data 
units including playback time information and having a 
stream of data packs to be reproduced within a given 
time period as a unit; and recording the data units on so 
the recording medium in a time-sequentially reproduci- 
ble manner, time information of that data unit which 
includes a sub-picture to be reproduced within the given 
time period being later by a predetermined time than 
time information of that data unit which inclines audio 25 
, data or video data to be reproduced within the given 
time period. J 

• The present invention also provides a reproducing 
apparatus comprising r a reproducing apparatus for 
reproducing reproduction data from a recording 30 
medium, comprising: means for acquiring, from the 
recording medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 
: time sequential manner; each object being repr6duced 
within a given time period, each of the data units being & 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
: audio data, video data and sub-picture data, time infor- 
mation of that data unit which includes a sub-picture to 40 
be reproduced within a given time period being later by 
a predetermined time than time information of that data 
unit which includes audio data or video data to be repro- 
duced within the given time period; and means for con- 
verting the data unit of the acquired reproduction data to 45 
a reproduction signal in accordance with the time infor- 
mation included In the data unit and reproducing the 
reproduction signal, whereby after reproduction data of 
that data unit which includes audio data or video data to 
; be reproduced within a given time period is reproduced, so 
the reproducing means reproduces reproduction data of 
the data unit including the sub-picture to be reproduced 
within the given period/ 

The present Invention also provides a reproducing 
apparatus , comprising U reproducing apparatus for ss 
reproducing reproduction data from a recording 
' medium, comprising: means for acquiring, from the 
recording medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 



time sequential manner, each object being reproduced 
within a given time period, each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data; and means 
for converting the data unit of the acquired reproduction 
data to a reproduction signal in accordance with the 
time information included in the data unit and reproduc- 
ing the reproduction signal, whereby after reproduction 
data of that data unit which includes audio data or video 
data to be reproduced within a given time period is 
reproduced, the reproducing means reproduces repro- 
duction data of the data unit including the sub-picture to 
be reproduced within the given period when a predeter- 
mined time previously set elapses. 

The present invention also provides a reproducing 
apparatus comprising a reproducing apparatus for 
reproducing reproduction data from a recording 
medium, comprising: means for acquiring, from the 
recoiding medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 
time sequential manner, each object being reproduced 
within a given time period, each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data; means for 
setting a delay time at which reproduction data of that 
data unit which includes a sub-picture to be reproduced 
within a given time period after reproduction data of that 
data unit which includes audio data or video data to be 
reproduced within the given time period is reproduced; 
and means for converting the data unit of the acquired 
reproduction data to a reproduction signal in accord- 
ance with the time information included in the data unit 
and reproducing the reproduction signal, whereby after 
reproduction data of that data unit which includes at 
least one of audio data and video data to be reproduced 
within a given time period is reproduced, the reproduc- 
ing means reproduces reproduction data of the data unit 
including the sub-picture to be reproduced within the 
given period when the set delay time elapses. 

The present invention also provides a reproducing 
apparatus comprising a reproducing apparatus for 
reproducing reproduction data from a recording 
medium, comprising: means for acquiring, from the : 
recoiding medium, a plurality of data units recorded 
thereon, which become objects to be reproduced in a 
time sequential manner, each object being reproduced 
within a given time period, each of the data units being 
constituted of a stream of a plurality of data packs and 
playback time information, the data packs containing 
packets of reproduction data including at least one of 
audio data, video data and sub-picture data, the time 
information of that data unit which includes a sub-pic- 
ture consisting of a playback start time and playback 
stop time; means for computing a delay time of the data 
unit including the sub-picture from the playback start 
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time and playback stop time recorded in the data unit 
including the sub-picture of the acquired reproduction 
data; and means for converting the data' unit of the 
acquired reproduction data to a reproduction signal in 
accordance with the time information included in the 5 
data unit and reproducing the: reproduction signal, 
whereby after reproduction data Of that data unit which 
includes at least one of audio data and video data to be 
reproduced within a given time period is reproduced, 
the reproducing means reproduces reproduction data of 70 
the data unit including the sub-picture to be reproduced 
within the given period when the| computed delay time 
elapses. 

. This invention can be more fully understood from 
the following detailed description when taken in con- is 
junction with the accompanying drawings, in which: 

FIG, 1 is a schematic block !diagram of an optical 
disk apparatus according to the first embodiment of 
the present invention; , & 
FIG. 2 is a detailed Hock diagram of the mechanical 
section of the disk drive unit of FIG. 1 ; 
FIG. 3 is a schematic perspective view of the struc- 
ture of an optical disk loaded in the disk drive unit of 
FIG.1; . 1 * s 

FIG. 4 shows the structure of the logic format of the 
optical disk of FIG. 3; 

FIG. 5 shows the structure of the video manager of 
FIG. 4; 

FIG. 6 shows an example bf the structure of the so 

video object set (VOBS) shown in FIG. 5; 

FIG. 7 is a diagram to help explain the structure of ; 

the video object unit of FIG. 6; 

FIG. 8 shows the parameters and contents of the 

volume manger, information management table 35 

(VMGLMAT) in the video manager (VMGI) of FIG. 

5; 

FIG. 9 shows the structure of the title search pointer 
table (TSPT) in the video manager (VMGI) of FIG 
5; :« 
FIG. 10 shows the parameters and contents of the 
title search pointer table information (TSPTI) in the 
title search pointer table (TSPT) of FIG. 9; 
FIG. 1 1 shows the parameters and contents of the 
title search pointer (TT_SRP) corresponding to the 45 
input number in the title search pointer table (TSPT) 
of FIG. 9; 

FIG. 1 2 illustrates the structure of the video title set 
of FIG. 4; 

FIG. 13 shows the parameters and contents of the so 
video title set information management table 
(VTSLMAT) of the video title set information (VTSI) 
of FIG" 12; 5 
FIG. 14 illustrates the structure of the video title set 
program chain information table (VTS_PGCIT) of 55 
the video title set information (VTSI) of FIG. 12; 
FIG. 15 shows the parameters and contents of the : 
information (VTS_PGCITI) in the video title set pro- 



gram chain information table (VTS.PGCIT) of FIG. 
14; 

FIG. 16 shows the parameters and contents of the 
search pointer (VTS_PGCITJ3RP) corresponding 
to the program chain in the video title set program 
chain information tabfe (VTS^PGCIT) of FIG. 14; 
FIG. 17 illustrates the structure of the program 
chain information (VTS^PGCI) in the video set cor- 
responding to the program chain in the video title 
set program chain information table (VTS.PGCIT) 
of FIG. 14; 

FIG. 18 shows the parameters and contents of the 

program chain general information (PGC_GI) in the 

program chain information (VTS_PGCI) of FIG. 17; 

FIG. 19 illustrates the structure of a program chain 

map (PGC_PGMAP) of the program chain into* ma- 

tion(VTS_PGCI)of FIG. 17; 

FIG. 20 shows the parameters and contents of the 

entry cell numbers (ECELLN) correspond ng to the 

programs written in the program chain map 

(PGC_PGMAP)ofFlG. 19; 

FIG. 21 illustrate the structure of the cell playback 

information table (C_PBIT) of the program chain 

information (VTS_PGCI) of FIG. 1 7; 

FIG 22 shows the parameters and contents of the 

cell playback information table (C_PBfT) of FIG 21; 

FIG. 23 illustrates the structure of the ceO position 

information (C POSI) in the program chain inter* 

mation(VTS_PGCI)ofFlG.1B; 

FIG. 24 shows the parameters and contents of the 

cell position information (C.POSI) of FIG, 23; 

FIG 25 illustrates the structure of the navigation 

pa*ofFG.23; 

FIG. 2B illustrates the structure of the video, audio, 
sub-picture, or VBI pack of FIG. 6; 
FIG. 27 shows the parameters and contents of the 
presentation control information (PCI) in the navi- 
gation pack of FIG. 26; 

FIG. 28 shows the parameters and contents of the 
general information (PCIJ3I) in the presentation 
control Information (PC!) of FIG. 27; 
FIG. 29 shows the parameters and contents of the 
disk search information (DSI) in the navigation pack 
of FIG, 26; 

FIG. 30 shows the parameters and contents of the 
DSI general information (DSI_G!) in the disk search 
information of FIG. 29; 

FIG. 31 shows the parameters and contents of the 
synchronizing playback information (SYNCI) on the 
video object (VOB) of FIG. 29; 
FIG. 32 shows the structure of a sub-picture unit: 
FIG. 33 shows parameters and contents of a sub- 
picture unit header (SPUH) of the sub-picture unit 
shown in FIG 32; 

FIG. 34 shows the parameters and contents of a 
display control sequence table (DCSQT) of the sii>- 
picture unit shown in FIG. 32; : 
FIG. 35 shows the parameters and contents of a 
display control sequence (DCSQ) shown in FIG 34; 
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FIGS. 36A through 36L present a timing chart for 

' explaining the relationship among an input clock, 

' output clock, PTS and DTS for use in the reproduc- 
tion of video data, audio data and sub : picture data; 

: FIG. 37 illustrates the structure of the video buffer 
section shown in FIG. 1; . 

j FIG. 38 illustrates] the structure of the video 

: decoder section shown in FIG. 1 ; 

! FK3. ; 39. illustrates [the structure of the audio 

.' decoder section shown in FIG. 1 ; 

: FIG. 40 illustrates the structure of the sub-picture 

*• decoder section shown in FIG. 1 ; 

i FK3. 41 Is a flowchart Illustrating the procedures of 

; reproducing video data, audio data and sub-picture 

: data; . 

' FIG; 42 is a flowchart illustrating the detailed repro- 
duction procedures; j 

• : FIGS. 43A through 43C show the output states of 

i video data, audio data and sub-picture data in the 

| reproduction process illustrated in FIG. 41 ; 
FIG. 44 is a block diagram schematically showing 

1 an optical disk apparatus according to the second 

= embodiment of this invention; 

j FIGS. 45A through 45M present a timing chart for 
explaining the relationship among an input clock, 

■ output clock, PTS and DTS for use in the reproduc- 
: ■ tion of video data, audio data and sub-picture data 

according to this second embodiment; 
; FIG. 46 is a flowchart illustrating the procedures of 
} reproducing video data, audio data and 6ub-picture 
I data by the optical disk apparatus shown in FIG. 44; 
; FIGS. 47A and 47B show display examples of a 

• menu on a key/display section according to the third 
j embodiment of this invention; 

; FIG. 48 is a flowchart illustrating the procedures of 
I reproducing video data, audio data and sub-picture 

data according to the third embodiment; 
; FIGS. 49A through 49M present a timing chart for 
' explaining the relationship among an input clock, 
; output clock, PTS and DTS for use in the reproduc- 
i tion of video data, audio data and sub-picture data 
: according to this fourth embodiment; 
i FK3L 50 is a flowchart illustrating the procedures of 
: reproducing video data, audio data and sub-picture 

• data by the optical disk apparatus shown in FIG. 48; 
FIGS. 51 A through 51C show the output states of 

' video data, audio data and sub-picture data at the 
. time 6uperimpositioh is displayed after a phrase; 
i; FIGS. 52A through 52C show the output states of 
V video data, audio data and sub-picture data at the 
time of displaying superimposition before freezing 
: the video and audio; 

• FIGS. 53 A through 53C show the output states of 
\ video data, audio data and sub-picture data at the 
: time sounds for only a phrase portion are repro- 

■ duced with 6ome delay and the video image and 
s sub^ictiire are frozen; 

; FIQS. 54A through 54C show the output states of 
: : video data, audio data and sub-picture data at the 



time the second sound is reproduced with some 
delay and the video image, sub-picture and first 
sound are frozen; 

FIGS. 55A through 55C show the output states of : 
5 video data, audio data and sub-picture data at the 
time the first sound and sub-picture are reproduced 
with some delay and the video image and second 
sound are frozen; 

FIGS. 56A through 56C show the output states of 
w video data, audio data and stfvpicture data at the 

time the second sub-picture is reproduced with 

some delay and the video Image, sounds and the . 

first sub-picture are frozen; . 

FIG, 57 is a block diagram schematically showing 
15 an optical disk apparatus according to another 

embodiment; 

FIGS. 58A and 58B show the output states of video 
data, audio data and sub-picture data at the time of 
presenting the mosaic display of sub-pictures for a 
20 delay time; 

FIG. 59 is a block diagram of an encoder system 
that encodes the video data and generates a video 
file; * 

FIG. 60 is a flowchart for an encoding process of 
25 FIG. 59; 

FIG. 61 is a flowchart for combining the main video 
data, audio data, and sup-picture data all encoded 
according to the f bw of FIG. 60 to create a video 
data file; 

$o FIG. 62 is a block diagram of a disk formatter sys- 
tem that records the formatted video files on an 
. opticaldisk; 

FIG. 63 is a flowchart for creating logic data to be 
recorded on a disk in the disk formatter of FIG. 62; 

35 FIG. 64 is a flowchart tor creating from the logic 
data the physical data to be recorded on a disk; and 
FIG. 65 is a schematic diagram of a system that 
transfers the video title set of FIG: 4 via a communi- 
cation route. 

40 

Hereinafter, referring to FIGS. 1 through 43C, an , 
optical disk reproducing apparatus according to the first 
embodiment of the present invention will be explained. 
FIG. 1 is a block diagram of an optical disk repro- 
45 ducing apparatus that reproduces the data from an opti- 
cal disk associated with an embodiment of the present 
invention. FIG. 2 is a block diagram of the disk drive sec- 
tion that drives the optical disk 6hown in FIG. 1 FIG. 3 
. shows the structure of the optical disk shown in FIGS. 1 

. so. and 2. 

: As shown in FIG. 1, the optical disk reproducing 
apparatus comprises a key/display section 4, a monitor 
: section 6, and a speaker section 8. When the user oper* 
■ ates the key/display section 4, this causes the recorded 
55 data to be reproduced from an optical disk 10. The 
recorded data contains video data, sub-picture data, 
and audio data, which are converted into video signals 
and audio signals. The monitor section 6 displays 
images according to the aucfio signats and the speaker 
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section 8 generates sound according to the audio sig- 
nals. ; : ! 

It is known that the optical disk 10 is available with 
various structures. For instance, one type of the optical 
disk 10 is a read-only disk on which data is recorded 
with a high density as shown in FIG. 3. The optical disk 
10, as shown in FIG. 3, is mado up of a pair of compos- 
ite layers 18 and an adhesive layer 20 sandwiched 
between the composite disk layers 18. Each of the com- 
posite disk layers 18 is composed of a transparent sub- 
strate 14 and a recording layer or a light-reflecting layer 
16. The disk layer 18 is arranged so that the light-reflect- 
ing layer 16 may be In contact with the surface of the 
adhesive layer 20. A center hole 22 is made in the opti- 
cal disk 10. On the periphery of the center hole 22 on 
both sides, clamping areas 24 are provided which are 
used to clamp the optical disk 10 during its rotation. 
When the disk 10 is loaded in the optical disk apparatus, 
the spindle of a spindle motor 12 shown in FIG. 2 is 
inserted into the center hole 22. As long as the disk is 
being rotated, it continues clamped at the clamping 
areas 24. • 

As shown in FIG. 3, the optical disk 10 has an infor- 
mation zone 25 around the clamping zone 24 on each 
side, the information zones allowing the information to 
be recorded on the optical disk 10. In each information 
area 25, its outer circumference area is determined to 
be a lead-out area 26 in which no information is nor- 
mally recorded, its inner circumference area adjoining 
the clamping area 24 is determined to be a lead-in area 
• 27 in which no information is normally recorded, and the 
area between the lead-out area 26 and the lead-in area 
27 is determined to be a data recording area 28. 

At the recording layer 16 in the information area 25, 
a continuous spiral track is normally formed as an area 
in which data is to be recorded. The continuous track is 
divided into a plurality of physical sectors, which are 
assigned serial numbers. On the basis of the sectors, 
data is recorded. The data recording area 28 in the 
information recording area 25 is an actual data record- 
ing area, in which management data, main video data, 
sub-picture data, and audio data are recorded In the 
form of pits (that is, in the form of changes in the physi- 
cal state) as explained later. With the read-only optical 
disk 10, a train of pits is previously formed in the trans- 
parent substrate 14 by a stamper, a reflecting layer is 
formed by evaporation on the surface of the transparent 
substrate 14 in which the pit train is formed, and the 
reflecting layer serves as the recording layer 16. In the 
read-only optical disk 10, a groove is normally not pro- 
vided as a track and the pit train in the surface of the 
transparent substrate 14 serves as a track. 

The optical disk apparatus 12, as shown in FIG. 1. 
further conprisesa cfisk drive section 30, a system CPU 
section 50. a system ROM/RAM section 52. a system 
processor section 54, a data RAM section 56, a buffer 
; control STC control section 57, a video decoder 58. a 
video buffer section 59, an audio decoder section 60, an 
audio buffer section 61, a sub-picture decoder section 



62, a sub-picture buffer section 63, a mixing section 64, 
a video D/A section 66 and an audio D/A section 68. 

As shown in FIG. 2, the disk drive section 30 con- 
tains a motor driving ctroit 1 1 , a spindle motor. 12. an 
s optical head 32 (i e.. an optical pickup), a feed motor 33. 
a focus circuit 36. a feed motor driving droit 37, a track- 
ing circuit 38. a head amplifier 40. and a servo process- 
ing circuit 44. The optical disk 10 is placed on the 
spindle motor 12 driven by the motor driving circuit 11 
w and is rotated by the spindle motor 1 2. The cptical head 
32 that projects a laser beam on the optical disk 10 is 
: located under the optical disk 1 0. The optical head 32 is 
placed on a guide mechanism (not shown). The feed 
motor driving circuit 37 is provided to supply a driving 
is signal to the feed motor 33. The motor 33 is driven by 
the driving signal and moves in and out the optical head 
32 across the racfius of the optical disk 10. "The optical 
head 32 is provided with an object lens 34 positioned so 
as to face the optical dsk 10. The object lens 34 is 
20 moved according to the driving signal supplied from the 
focus circuit 36 so as to move along its cptical axis. 

To reproduce the data from the above optica! disk, 
the optical head 32 projects a laser beam on the optica! 
disk 10 via the object lens 34. The object lens 34 is 
25 moved little by tittle across the radius of the optical disk 
. 10 according to the driving signal supplied from the 
tracking circuit 38. Furthermore, the object lens 34 is 
moved along its optical axis according to the driving sig- 
nal supplied from the focusing circuit 36 so that its tocal 
so point may be positioned on the recording layer 15 of the 
opticat disk 10. This causes the laser beam to toon the 
smallest beam spot on the spiral track (i.e.. the pit train), 
enabling the beam spot to trace the track The laser 
beam is reflected from the recording layer 16 and 
35 returned to the optical head 32. The optical head 32 
converts the beam reflected from the optical disk 10 into 
an electric signal, which is supplied from the optical 
head 32 to the servo processing circuit 44 via the head 
arrptif ier 40. From the electric signal, the servo process- 
40 ing circuit 44 produces a focus signal, a tracking signal, 
and a motor control signal and supplies these signals to 
the focus circuit 36, tracking circiit 38, and motor drrving 
circuit Irrespectively. 

Therefore, the object lens 34 is moved along its 
45 optical axis and across the radius of the optical disk 1 0, 
its focal point ts positioned on the recording tayer 16 of 
the optical disk 10. and the laser beam forms the smal- 
est beam spot on the spiral track. Furthermore, the span- 
die motor 12 is rotated by the motor driving circuit 1 1 at 
so a specific rotating speed. This allows the beam to track 
at, tor example, a constant linear speed. 

The system CPU section 50 of FIG. 1 supplies to 
the servo processing circuit 44 a control signal serving 
as an access signal. In response to the control signal. 
55 the servo processing droit 44 supplies a head-moving 
signal to the feed motor driving circuit 37. which sxp- 
plies a drrving signal to the feed motor 33. Then, the 
feed motor 33 is driven, causing the optical head 32 to 
move across the radius of the optical disk 10. Then, the 
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optical head 32 accesses a specific sector formed at the 
recording layer 16 of the : optical disk 10. The data is 
reproduced from the specific sector by the optical head 
32, which then supplies it to the head amplifier 40. The 
head amplifier 40 amplifies the reproduced data, which 
is butputted at the disk drive section 30. 
• I The reproduced data is transferred and stored in a 
data RAM section 56 by the system processor section 
54 which is controlled by the system CPU section 50 
which is operated in - accordance with the programs 
stored in the system ROM/RAM section 52. The stored 
reproduced data is processed at the system processor 
section 54, which sorts the data into video data, audio 
data, and sub-picture data. The video data is sent via 
the video buffer section 59 to the video decoder section 
58 to be decoded, the audio data is sent via the audio 
buffer section 61 to the audio decoder section 66 to be 
decoded, and the sub-picture data is sent via the sub- 
picture buffer section 63 to the sub-picture decoder sec- 
tion 62 to be decoded.- The decoded video data and 
sub-picttfe data are mixed by the mixing section 64, 
and the resultant data is converted to an analog video 
signal by the video D/A section 66. This analog video 
signal is then sipplied to the monitor section 6. The 
audio data Is converted by the audio D/A section 68 to 
an audio signal which is supplied to the speaker section 
8.; Then, on the basis of the video signal, an image is 
i displayed on the monitor section 6 and according to the 
audio signal, sound is simultaneously reproduced from 
the speaker section 8. \ 

> . The detailed operation of the optical disk apparatus 
of FIG. 1 will be described later with reference to the 
logic format of the optical disk explained below. 

The data recording area 28 between the lead-in 
area 27 and the lead-out area 26 on the optical disk of 
FIQ. 1 has a volume and file structure as shown in FIG. 
4; The structure has been determined in conformity to 
specific logic format standards, such as Micro UDF or 
- ISO 9660. The data recording area 28 is physically 
divided into a plurality of sectors as described earlier. 
These physical sectors are assigned serial numbers. In 
the following explanation, a logical address means a 
logical sector number (LSN) as determined in Micro 
UDF or ISO 9660. Like a physical sector, a logical sector 
contains 2048 bytes. The numbers (LSN) of logical sec- 
tors are assigned consecutively in ascending order as 
the physical sector number increments, 
v As shown in FIG! 4, the volume and file structure is 
. a hierarchic structure and contains a volume and ffle 
structure area 70, a video manager 71, at least one 
video title set #i 72, and another recorded area 73. 
These areas 70, 71 , 72, 73 are aligned with the bound- 
aries between logical sectors. As with a conventional 
CD, a logical sector is;defined as a set of 2048 bytes. 
Accordingly, one logical sector corresponds to one logi- 
cal block. ... 1 

The volume and file structure area 70 corresponds 

to a management area determined in Micro UDF or ISO 
= 9660. According to the description in the management 



: area, the video manager 71 is stored in the system 
ROM/RAM section 52. As explained with reference to 
FIG. 5, the information used to manage video title sets 
72 is written in the video manager 71, which is com- 
5 posed of a plurality of files, starting with file #0. In each , 
video title set 72, compressed video data, compressed 
audio data, compressed sub-picture data, and the : 
reproducing information about these data items are 
stored as explained later. Each video title set is com- 
jo posed of a plurality of files 74. The number of video title 
sets 72 is limited to a maximum of 99. Furthermore, the ; 
nurrber of files 74 (from file #j to file *j+9) constituting 
each video title set 72 is determined to be a maximum 
of 10. These files 74 are also aligned with the bounde- 
rs ries between logical sectors. 

In the other recorded area 73, the information capa- 
ble of utilizing the aforementioned video title sets 72 is 
recorded. The other recorded areas 73 are not neces- 
sarily provided. . •= : ■ 
so As shown in FIG. 5, the video manager 71 contains 
at least three Hems each corresponding to individual 
files 74. Specifically, the video manager 71 is made up 
of volume manager information (VMGI) 75. a video 
object set for video manager menu ( VMGM_VOBS) 76, 
25 and backup of video manager information (VMGIJJUP) 
77. Here, the volume manager information (VMGI) 75 
and the backup of video manager information 
(VMGLBUP) 77 are determined to be indispensable 
Hems, and the video object set for video manager menu 
30 (VMGM VOBS) 76 is determined to be an optional 
item. Inlhe video object set 76 for VMGM, the video 
: : data, audio data, and sup-picture data about a menu of 
the volumes of the optical disk managed by the video 
manager 71 are stored. 
35 By the video object set 76 for VMGM 
(VMGM_VOBS), the volume name of the optical disk 
10. the sound accompanying the volume name repre- 
sentation, and the description of the sub-picture are dis- 
played and at the same time, selectable items are 
AO provided in the form of sub-pictures as in video repro- 
duction explained later. For example, the video object 
set 76 for VMGM (VMGM_VOBS) indicates that the 
optical disk 10 contains the video data representing 
English conversation for learning English. Specifically, 
45 lessons on English conversation, together with a vol- 
ume name, such as the contents of English conversa- 
tion, is reproduced in the form of video data and at the 
same time, a theme 6ong is reproduced in sound, and 
the level of the teaching material is displayed in a 6up- 
50 picture. Furthermore, the user is asked which one of 
lessens 1 to N to select Thus, for example, the VMGM 
• video object set 76 (VMGM_VOBS) provides the user 
with preparations to watch an English conversation pro- 
gram for learning English. 
55 Here, the structure of a video object set (VOBS) 82 
will be described with reference to FtG. 6. FIG. 6 shows 
an example of a video object set (VOBS) 82. The video 
object set (VOBS) 82 comes in three types for two 
menus and a title. Specifically, the video object set 
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(VOBS) 82 contains the video title Bet for video manager 
menu (VMGM_VOBS) 76. a'; video object set 
(VTSM_VOBS) 95 for a menu in the video title sets 72 
and a video object set (VTSTTVOBS) 82 for the titles 
of at least one video title set 72 in a video title set (VTS) 
72 as explained later. Each video object set 82 has the 
same structure except that their uses differ, j j 

As shown in FIG. 6. a video object set (VOBS) 82 is 
defined as a set of one or more video objects (VOB) 83. 
The video objects 83 in a video object set (VOBS) 82 is 
used for the same application.! A video object set 
(VOBS) 82 for menus is usually made up of one video 
object (VOB) 83 and stores the data used to display a 
plurality of menu screens. In contrast, a video object set 
(VTSTT_VOBS) 82 for title sets is usually composed of 
a plurality of video objects (VOB) 83. j 

When the aforementioned video of an English con- 
versation program for learning ;English is taken as 
example, a video object (VOB) 83 corresponds to the 
video data of each lessen. Specifying a particular video 
object (VOB) 83 enables, for example, lesson 1 to be 
reproduced on a video. ; The video j object set 
(VTSMJ/OBS) 95 for a menu of the video title sets 72 
contains the menu data for the English conversation. 
According to the presentation of the menu, a particular 
lesson, for example, lesson 1, can be specified. In the 
case of a usual single story movie, one video object 
(VOB) 83 corresponds to one video object set (VOBS) 
82. One video stream is completed with one video 
object set (VOBS) 82. In the case of a collection of ani- 
mated cartoons or an omnibus' movie, a plurality of 
video streams each corresponding to individual stories 
are provided in a single video dbject set (VOBS) 82. 
Each video stream is stored in the corresponding video 
object 83. Accordingly, the audio stream and sub-pic- 
ture stream related to the video stream are also com- 
pleted with each video object (VOB) 83. 

An identification number (lDN#j) is assigned to a 
video object (VOB) 83. By the identification number 
(ID#j), the video object (VOB) 83 can be identified. A 
video object (VOB) 83 further comprises one or more 
such cells 84. Although a usual video stream Is made up 
of a plurality of cells 84, a menu video stream, or a video 
object (VOB) 83 may be composed of one cell 84. A cell 
84 is likewise assigned an identification number 
(CJDN#j). By the identification number (CJDN#j), the 
cell 84 is identified. |. 

As shown in FIG. 6, each cell 84 is composed of 
one or more video object units (VOBU) 85, normally a 
plurality of video object units (VOBU) 85. Here, a video 
object unit (VOBU) 85 is defined as a pack train having 
a navigation pack (NAV pack) 86 at its head. Specifi- 
cally, a video object unit (VOBU) 85 is defined as a set 
of all the packs recorded, starting at a navigation pack 
(NAV pack) 86 to immediately in front of the next naviga- 
tion pack. The reproducing time of the video object unit 
(VOBU) 85 corresponds to the reproducing time of the 
video data made up of one or more GOP (Group of Pic- 
tures) contained in the video object unit (VOBU) 85 as 



shown in FIG. 6. The maximum reproducing time is 
determined to be 0.4 or more second and less than one 
. second. In MPEG, one GOP is defined as compressed 
image data which corresponds to about 1 5 frames to be 
5 played back for, usually. 0.5 seconds. 

In the case where the video data includes a video 
object unit as illustrated in FIG 6. GOPs each com- 
posed of a video pack (V pack) 88. a sub-picture pa* 
(SP pack) 90 and an audio pack (A pack) 91 , all comp* y- 
w ing to the MPEG standards, are arranged, producing a 
vide data stream. Regardless of the number of GOPs. a 
video object (VOBU) 83 is determined based on the 
time required for producing a GOP. In the video object 
(VOBU) 83 has a navigation pack (NV) pack 86 
is arranged at its head. Any reproduced data, whether 
audio data, sub-picture data, or aucCofcub-pictue data, 
consists of one more video object units. Thus, even if a 
video object unit is composed of only aucfio packs only, 
these audio packs will be reproduced within the time for 
20 reproducing the video object unit The procedure of 
reproducing these packs will be explained later in detai, 
along with the procedure of reproducing the navigation 
pack (NV pack) 86. 

The procedure for reproducing these pari*. 
25 together with the navigation pack, will be explained in 
detaa later. \ 

The video manager 71 will be explained with refer- 
ence to FIG. 5. The vdume management information 75 
placed at the head of the video manager 71 contains the 
30 information used to search for titles and the bformafon 
used to manage the video title sets (VTS) 72 such as 
the information used for reproduction of a video man- 
ager menu. The volume management information 75 
contains at least three tables 78, 79. 80 in the order 
35 shown in FIG. 5. Each of these tables 78, 79, 80 is 
aligned with the boundaries between logical sectors. A 
first table 78, a volume manger information manage- 
ment table (VMGLMAT) 78 is a mandatory table, in 
which the size of The video manager 71. the starting 
40 address of each piece of the information in the video 
manger 71, and the attrtoute information about the 
video object set (VMGM J/OBS) 76 tor a video manager 
menu are written. j 

Written in a second table of the video manager 71 . 
45 a title search pointer table 79 (TT_SRPT), is en entry 
program chain (EPGC) of the video titles (VTS) 72 con- 
tained in the optical disk 10 that are selectable accord- 
ing to the entry of a title number from the keyJdisplay 
section 4 on tha apparatus. 
so Here, a program chain 87 is a set of programs 89 
that reproduce the story of a titSe as shown in FIG. 7. 
Continuous reproduction of a program chain 87 com- 
pletes an educational program such as English conver- 
sation tor learning English of a title. Therefore, the user 
55 can start to see the English conversation from a partic- 
ular scene of the conversation by specifying the pro- 
gram 89. 

In a third table of the video manager 71 , a video title 
set attribution table (VTS_ATRT) 80, the attrfcute infer- 
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mation determined in the video title set 72 in the volume 
of the optical disk 10 is written. Specifically, in this table 
72, the following items are written as attribute informa- 
tion: the number of video title sets, video title set num- 
bers, video attributes, 1 such as a video data 
compression scheme, audio stream attributes, such as 
an audio coding mode, and sub-picture attributes, such 
as the type of sup-picture display. 

• The contents of the' volume manager information 
management table (VMGI_MAT) 78 and the title search 
pointer table (TT_SRPT) 79 will be explained in detail 
with reference to FIGS. 8, 9, 10. and 1 1 . 

'.| As shown In FIG. 8, w^en In the volume manager 
Information management table (VMGI_MAT) 78 are a 
video manager Identifier (VMQJD), the size of video 
manager information (VMGI_SZ) in logical blocks (one 
logical block contains 2048 bytes as mentioned above), 
the version number (VERN) of the optical disk 10 com- 
plying with the digital versatile disk (DVD) video specifi- 
cation, and the category of video manager 71 
(VMG_CAT). ' .. i 

i In the category of video manager 71 (VMG_CAT). a 
flag indicating whether or not the DVD video directory 
prohibits copying is written. Further written in the table 
(VMGI_MAT) are a volume set identifier (VLMS_ID). the 
number of video title sets (VTS_Ns). the identifier for a 
person supplying the data to be recorded oh the disk 
(Provider Unique ID: PVRJD). a video manager menu 
video object set start address (VNGM_VOBS_SA), the 
end address (VMGI_MAT_EA) of a volume manager 
information management table (VMGI-MAT) 78. and the 
start address (TT_SRPT_SA) of a title search pointer 
table (TT_SRPT) 79. The end address of VMGJ/IAT 78 
(VMGI MAT_EA) and the start address of TT_SRPT 
(TT SRPT.SA) 79 are 'represented by the number of 
logical blocks, relative to the first logical block. : 
- Furthermore, in the table 78, the start address 
• (VTS ATRT SA) of the attribute table (VTS_ATRT) 80 
of video title sets (VTS) 72 is represented by the 
number of bytes, relative to the first byte in the VMGI 
manager table (VMGI_MAT) 71, and the video attribute 
(VMGM V AST) of the video manager menu (VMGM) 
Is written. Further written in the table 78 are the number 
of audio streams (VMGM_.AST.Ns) in the video man- 
ager menu (VMGM). the attributes of audio streams 
: (VMGM_AST_ATR) in' the video manager menu 
: (VMGM)i the number of sub-picture " streams 
(VMGM SPST_Ns) in the video manager menu 
(VMGM)] and . the attributes of sub-picture streams 
(VMGM_.SPST_ATR) in the video manager menu 

(VMGM)! ! 
I In the title search pointer table (TT_SRPT) 79, as 
shown in FIG. 9. the title search pointer table informa- 
tion (TSPTlj isf irst written and then as many title search 
pointers for input numbers 1 to n (n s 99) as are needed 
are written consecutively. When only the reproducing 
data for one title, for example, only the video data for 
one title, Is stored in the volume of the optical disk, only 
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one title search pointer (TT_SRP) 93 is written in the 
; table (TT.SRPT) 79. 

The title search pointer table information (TSPTI) 
92 contains the number of entry program chains 
5 (EN_PGC_Ns) and the end address (TT_SRPTJ=A) of 
the title search pointer 93 as shown in FIG. 10. The 
address (TT_SRPT_EA) is represented by the number 
of bytes, relative to the first byte in the title search 
pointer table (TT_SRPT) 79. Furthermore, as shown in 
w FIG. 1 1 . each title search pointer (TT_SRP) 93 contains 
the video title set number (VTSN). the program chain 
number (PGCN). and the start address (VTS_SA) of the 
video title set 72. The contents of the title search pointer 

(TT SRP) 93 specifies a video title set 72 to be repro- 
15 duced and a program chain (PGC) 87 as well as a loca- 
tion in which the video title set 72 is to be stored. The 
start address (VTS_SA) of the video title set 72 is repre- 
sented by the number of logical blocks in connection 
with the title set 72 specified by the video title set 

so . number (VTSN). 

The structure of the logic format of the video title set 
72 shown in FIG. 4 will be described with reference to 
FIG. 1 2. In each video title set (VTS) 72, four hems are 
written in the order shown in FIG. 12. Each video title 
25 set (VTS) 72 is made up of one or more video titles hav- 
ing common attributes. The video title set information 
(VTSI) 94 contains the management information on the 
video titles, including the information on entry search 
points, the information on playback of video object sets 
30 72. the information on playback of title set menus 
(VTSM). and the attribute information on video object 
sets 72. 

Each video title set 72 is provided with the backup 
of the video title set information (VTSI_BUP) 97. 
35 Between the video title set information (VTSI) and the 
backup of the information (VTSI_BUP) 97, a video 
object set for video title set menus (VTSM_VOBS) 95 
and a video object set for video title set titles 
(VTSTT VOBS) 96 are arranged. Both of the video 
40 object sets (VTSM.VOBS and VTSTT_VOBS) 95. 96 
have the structure shown in FIG. 6. as explained earlier. 

The video title set Information (VTSI) 94, the 
backup of the information (VTSLBUP) 97. and the 
video object set (VTSTT.VOBS) 96 for video title set 
45 titles are items indispensable to the video title set 72. 
The video object set (VTSM_VOBS) 96 tor video title set 
menus Is an option provided as the need arises. 

The video title 6et information (VTSI) 94 consists of 
four tables as shown in FIG. 12. The four tables are 
so forced to align with the boundaries between logical sec- 
tors. The video title set information management table 
(VTSI MAT) 98, a first table, is a mandatory table, in 
whichlhe size of the video title set (VTS) 72. the start 
addresses of each piece of information in the video title 
55 set (VTS) 72. and the attributes of the video object sets 
(VOBS) 96 in the video title set (VTS) 72 are written. 
The video title set direct access pointer table 
' (VTS DAPT) 99. a second table, Is an optional table, 
provided as the need arises. Written in the table 99 are 
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the program chains (PGC) 87 and/or programs (PG) 89 
contained in the video title set 72 that are selectable 
according to the entry of a title number from the key/dis- 
play section 4 of the apparatus, j ! 

The video title set program chain information table s 
(VTS PGCIT) 100. a third table, is a mandatory table, in 
which"the VTS program chain information (VTSJ'GCI) 
104 is written. The video title set time search map table 
(VTS_MAPT) 101, a fourth table, is an optional table 
provided as the need arises, in which the information on 10 
the recording location, tor a specific period of time of 
display, of the video data in each program chain (PGC) 
87 in the title set 72 to which the [ map jable 
(VTSJ^APT) 101 belongs is written. 

Next, the video title information management table is 
(VTSLMAT) 98 and video title set program chain infor- 
mation table (VTSIJPGCIT) 100 Shown in FIG. 12 will 
be described with reference to FIGS. 1 3 to 20. . j 

FIG. 13 shows the contents of the video title infor- 
mation management table (VTSLMAT) 98, in which the a> 
video title 68t identifier (VTSJD). the size of the video 
title set 72 (VTS_SZ), the version number of the DVD 
video specification (VERN), and the video title set cate- : 
gory (VTS_CAT) are written in that order. Furthermore, 
in the table (VTSLMAT) 98. the : start address of the 25 
video object set (VTSM_VOBS) for VTS menus is 
expressed by a logical block relative to the first logical . 
block in the video title set (VTS) 72. The start address 
(WSTT_VOB_SA) of the video object 83 for titles in the 
video title set (VTS) 72 is expressed by a logical block so 
(RLBN) relative to the f irst logical block in the video title 
set (VTS) 72. ' j* i 

Furthermore, in the table (VTSLMAT) 98, the end 
address (VTLMATEA) of the video title set information 
managemenftable (VTI_MAT) 98 is represented by the 35 
number of blocks, relative to the first byte in the table 
(VTLMAT), 98 and the start address of the video title 
set direct access pointer table ( VTS_DAPT) 99 is repre- 
sented by the number of blocks, relative to the first byte 
in the video title set information (VTSI) 94 J \ ■ 40 

Still furthermore, in the table (VTSLMAT) 98, the 
start address (VTS_PGCIT_SA) of the video title set 
program chain information table (PGCIT) 100 is 
expressed by the number of blocks, relative to the first 
byte of the video title set information (VTSI) 94, and the 45 
start address (VTS_MAPT_SA) of the time search map 
(VTS.MAPT) 101 In the video jtitle set (VTS) 72 is 
expressed by a logical sector relative to the first logical 
sector in the video title set (VTS) 72. Written in the table 
(VTSLMAT) 98 are the video object set (VTSM_VOBS) 50 
95 forlhe video title set menu (VTSM) in the video title 
set (VTS) 72, the video attributes (VTS_V_ATR) of the 
video object set (VTSTJ/OBS) 96 for the titles (VTSTT) 
in the video title set 72, and the number of audio 
streams (VTS_ASTJJs) in the video, object set 55 
(VTSTTJ/OBS) 82 for the titles (VTSTT) for the video 
title sets 72. Here, the video attributes (VTS_V_ATR) 
include a video compression mode, a frame rate of the 



TV system, and an aspect ratio for displaying an image 
on a display unit. 

Written in the table (VTSLMAT) 98 are the audio 
stream attributes (VTS_AST_ATR) of the video object 
set (VTST VOBS) for the titles (VTSTT) in the video Me 
set (VTSfThe attributes (VTS_AST_ATR) include an 
audio encoding mode indicating how audio Is encoded, 
the number of bits used to quantize audio, and the 
number of audio channels. 

Furthermore, written in the table (VTSLMAT) 93 
are the number (VTS_SPST_Ns) of sub-picture 
streams in the video object set 82 fa the titles (VTSTT) 
in the video title set (VTS) 72 and the attrfcutes 
(VTS SPST_ATR) of each sub-picture stream. The 
attributes (VTR_SPST_ATR) for each sub-picture 
stream include a sub-picture coring mode and a sii> 
picture display type. 

Furthermore, in the table (VTSLMAT) 98, written 
are the number (VTSM_AST_Ns) of audio streams in 
the video title set menu (VTSM), the audio stream 
attributes (VTSM_AST_ATR), the dumber 
(VTSM_SPST_Ns) of sup-picture streams, and the sup- 
picture stream attributes (VISM_SPST_ATR). : 

The VTS program chain information table 
(VTS^PGCIT) 1 00 has a structure as shown in FIG. 1 4. 
In the information table (VTS_PGCIT) 100. information 
on the VTS program chain (VTS.PGC) is written, start- 
ing with information (VTS^PGCITJ) 102 on the infor- 
mation table (VTS.PGCIT) 100 related to the VTS 
program chain (vfsj>GC). In the information table 
(VTS FK5CIT)10O.theinforrra6on(VTS.PGCrr_l)102 
is followed by as many VTS_PGCI search pointer 
(VTS_PGCIT_SRP) 103 used to search for VTS pro- 
grarnchains (VTS^PGC) as the number (#1 to #n) of 
VTS program chains in the information table 
(VTS_PGCIT). At the end of the table, there are pro- 
vided^ many peces of information (VTS.PGCI) 104 
on the respective VTS program chains (VTS_PGC) as 
the number (from #1 to #n) of the VTS program chains 
(VTS_PGC). 

The information (VTS_PGCITJ) 102 In the VTS 
program chain information table (VTS_PGCtT) 100 con- 
tains the number (VTS_PGC_Ns) of VTS program 
chains (VTS_PGC) as shown in FK3. 15. The end 
address (VTS_PGCIT_EA) of the table information 
(VTS_PGCITJ) 102 is expressed by the number of 
bytes, relative to the first byte in the information table 
(VTS_PGCIT)100. 

Furthermore, as shown in FIG. 16. the VTS_PGCIT 
search pointer (VTSJ > GCIT_SRP) 1C3 contains the 
attributes (VTS_PGC_CAT) of the program chains 
(VTS_PGC) in the video title set (VTS) 72 and the start 
address (VTS_PGCLSA) of the VTS.PGC information 
(VTSJH3CI) 104 expressed by the number of bytes, rel- 
ative To the first byte in the VTS_PGC information table 
(VTS_PGCIT) 100. Here, the VTS_PGC : attribute 
(VTS_PGC.CAT) is, for example, an attribute indicating 
whether an entry program chain (Entry PGC) is the first 
one to be reproduced. Usually, an entry program chain 
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(PGC) is written before program chains (PGC) that are 
not entry program chains (PGC). Generally, program 
chains (PGC) are reproduced in the description order of 
VTS_PGCIs as shown in FIG. 14. 
: The PGC information (VTSPGCI) 104 in the video 
titte set, 72 contains four jtems as shown in FK3. 17, In 
the PQC information (VTS.PGCl) 104, the program 
chain general information (PGCJ3I) 105 on a manda- 
tory item is first arranged, - followed by at least three 
items that are made mandatory only when there is an 
video object ; 83. Specifically, contained as the three 
items in the PGC information (VTS_PGCI) 104 are a 
program chain program map (PGC_PGMAP) 106, a cell 
playback information table (CJ>BIT) 107, and a cell 
position information table (C.POSIT) 1 08. 
. \ As shown in FIG. 18, the program chain general 
information (PGCJ3I) ;105 contains the category 
(PGCI_CAT): of the program chain 87, the contents 
(PGC_CNT) of the program chain (PGC) 87, and the 
playback time of the program chain (PGC). 87 Written in 
the category of PGC (PGCLCAT) are whether the PGC 
can be copied or not and whether the programs 89 in 
the PGC are played back continuously or at random. 
The contents of PGC (PGC_CNT) contains the descrip- 
tion of the program chain structure, that is, the number 
of programs 89, the number of cells 84, and the number 
of angles in the program chain 87. The playback time of 
PGC (PGC_PBJTIME) contains the total playback time 
of the programs 89 in the PGC. The playback time is the 
time required to continuously play back the programs 89 
in the PGC, regardless of the playback procedure. 

f Furthermore, the program chain general informa- 
tion (PGCJ3I) 1 05 contains PGC sub-picture stream 
control (PGC^SPSTJJTL), PGC audio stream control 
(PGCj*STJ:TL), and . PGC sub-picture ; pallet 
(PGCISP_PLT). The PGC sub-picture stream control 
(PGC_SPST_CTL) contains the number of sub-pictures 
usable in the PGC 89 and the PGC audio stream control 
(PGC_AST_CTl.) likewise contains the number of audio , 
streams usable in the PGC 89. The PGC sub-picture 
palette (PGC_SP_PLT) ; contains a set of a specific 
number of color pallets 'used In all of the sub-picture 
strieams in the PGC 89. y 

J Furthermore, the PGC general information 
(PGC_GI) 105 contains the start address (C_PBIT_SA) 
of thecell playback Information table (C_PBIT) and the 
start address (C_POSlT_SA) of the cell position infor- 
mation table (5 POSiT) 108. Both of the start 
addresses (CJ>BIT_SA and C_POSIT_SA) are repre- 
sented by the~number of logical blocks/ relative to the 
first byte in the VTS_PGC information (VTS_PGCI) 1 05. 
j The program chain program map (PGC_PGMAP) 
108 is a map showing thiB arrangement of the programs 
89 in the PGC 87 of FIG.19. In the map (PGC_PGWIAP) 
106, the entry cell numbers (ECELLN). the start cell 
numbers of the individual programs 89, are written in 
ascending order as shown in FIGS. 19 and 20. In addi- 
tion, program numbers are allocated, starting at 1 , in the 
order in which the entry cell numbers are written. Con- 



sequently, the first entry number in the map 
(PGC_PGMAP) 106 must be #1. 

The cell playback information table (C_PBIT) 
defines the order in which the cells 84 in the PGC 87 are 

5 played back. In the cell playback information table 
(C.PBIT) 107, pieces of the cell playback information 
(C IPBI) are written consecutively as shown in FIG. 21 . 
Basically, cells 84 are played back in the order of cell 
nurrtoer. The cell playback information <C_PBIT) 108 

10 contains a cell category (C_CAT) as shown in FIG. 22. 
Written in the cell category (CJDAT) are a cell block 
mode indicating whether a cell is in the block and if it is 
In the block, whether the cell is the first one, a cell block 
type indicating whether a cetl 84 is not part of the block 

is or ie in an angle block, and an STC discontinuity flag : 
indicating whether the system time clock (STC) must be 
set again. 

..' Further written in the cetl category (C_CAT) are a 
: cell playback mode indicating whether the video object 
20 units (VOBU) 85 in the cell 84 are played back continu- 
ously or a picture is made 6till at one video object unit 
(VOBU) 85 to another in the celt 84, and cetl navigation 
control incficating whether the picture is made still after 
the playback of the cetl or indicating the rest time. 
25 As shown in FIG. 22, the cell playback information 
table (CJ>BIT) 107 contains the cell playback time 
(C.PBTNM) representing the total playback time of the 
PGC 87. When the PGC 87 has an angle cell block, the 
playback time of the angle cell number 1 represents the 
so playback time of the angle block. Further written in the 
cell playback information table (C.PBIT) 107 are the 
start address (C_FVOBlLSA) of the first video object 
unit (VOBS) 85 in the cell 84 expressed by the number 
. of logical sectors, relative to the first logical sector in the 
35 video object unit (VOBS) 85 in which the cell 84 is writ- 
ten and the start address (C_LVOBU_SA) of the end 
video object unit (VOBS) 85 in the cell 84 expressed by 
the number of logical sectors, relative to the first logical 
sector in the video object unit (VOBS) 85 in which the 
40 cell 84 is written. 

The cell position Information table (C_POSI) 108 
specifies the Identification number (VOBJD) of the 
video object (VOB) 85 in the cell used in the PGC 87 
and the identification number (Cell jD) of the cell 84. In 
45 the cell position information table (C_POSI) 108, pieces 
of the cell position information (C_POSI) corresponding 
to the cell numbers written in the cell playback informa- 
tion table 107 as shown in FIG. 23 are written in the 
. same order as in the ceil playback information table 
so (C_PBIT) 107. The cell position information (C_POSI) 
contains the 'identification number (C_VOB_IDN) of the 
video object unit (VOBS) 85 in the cell 84 and the cell 
identification number (CJDN) as shown in FIG. 24. 
As explained with reference to FIG. 6, a cell 84 is a 
55 set of video object units (VOBU) 85. A video object unit 
. 85 is defined as a pack train starting with a navigation 
(NAV) pack 86. Therefore, the start address 
(C_FVOBU_SA) of the first video object unit (VOBU) 85 
in a cell 847s the start address of the NAV pack 86. As 
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shown in FIQ. 25, the NAV pack 86 consists of a pack , 
header 1 1 0. a system header 1 1 1 , and two packets 1 1 6. 
1 17 of navigation data; namely, a presentation control : 
information (PCI) packet 116 and a data search infor- 
mation (DSI) packet 117. As many bytes as shown in 5 
FIQ. 25 are allocated to the respective sections so that 
one pack may contain 2048 byted corresponding to one 
logical sector. The NV pack is 'provided immediately ; 
before the video pack 88 which contains the first data 
item in the group of pictures (GOP). Even if the object 10 
unit 85 contains no video pack 88, the NV pack 86 is 
positioned at the head of the object unit 85. provided 
that the object unit 85 contains an audio pack 91 and/or 
a sub-picture pack 90. Thus, even if object unit 85 con- 
tains no video pack, its playback time is determined on T5 
the basis ol the time required for playing back a video 
pack 88, exactly in the same way as in the case where ' 
the unit 85 contains a video pack 88. 

Here, GOP is defined as a data train constituting a 
screen determined in the MPEG standards. In other so 
words, GOP Is equivalent to compressed data which 
may be expanded into image data representing a plural- • 
ity of frames of a moving picture; The pack header 1 1 0 . 
contains a pack starting code, a system dock reference 
(SCR), and a multiplex rata The system header 111 25 
contains a bit rate and a stream ID. The packet header 
1 12. 1 1 4 of each of the PCI packet 1 1 6 and DCI packet 
1 17 contains a packet starting code, a packet length, 
and a stream ID as determined in the MPEG2. . j 

As shown in FIGL 26. another video park 88, audio 30 
park 91 or sifc-picture pack 90 consists of a pack 
header 120, packet header 121 , and a packet 122 con- 
taining the corresponding data as in the system layer 24 . 
MPEG 2. Its pack length is determined to be 2048 
bytes. Each of these packs is aligned with the bounda- 35 
ries between logical blocks. | 

It is to be noted that PTS (Presentation Time . 
Stamp; time management information for the repro- 
duced output) and DTS (Decoding Time Stamp; decod- 
ing time management information) are additionally *o 
stored In the packet header 121 of the video pack 88 
which includes head data of the j picture of GOP. F^TS Is 
additionally stored in the packet header 121 of the audio 
pack 91 . PTS is additionally stored in the packet header 
121 of the sub-picture pack 90 which includes the head 45 
data of a sub-picture unit consisting of a plurality of sub- 
picture packs 90 for one still picture to be reproduced at 
the same time. j . . j ; 

SCR to be stored in each ' pack increases in the 
recording order on the optical disk 10 with the value of so 
the head pack of (video) data for each video object 
taken as 0. j ; 

The PCI data (PCI) 113 inithe PCI packet 116 is 
navigation data used to make" a presentation, or to 
change the contents of the display, in synchronization 55 
with the playback of the video data in the VOB unit 
(VOBU) 85. Specifically, the PCI data (PCI) 113 con- 
tains PCI general information (PCLGI) as information 
on the entire PCI data 1 1 3 change as shown in FIG. 27. < 



The PCI general information (PCLGI) contains the 
address (IWPCK.LBN) of the NV pack (NVPCK) 86 
in which the PCI data is recorded as shown in FIG. 28. 
the address being expressed in the number of blocks, 
relative to the VOBU logical sector in which the PCI data 
is recorded. The PCI general information (PCLGI) con- 
tains the category of VOBU (VOBU.CAT), the start PTS 
of VOBU 85 (VOBUSPTS). and the end PTS of VOBU 
85 (VOBU.EPTS). Here, the start PTS of VOBU 85 
(VOBU_SPTS) indicates the playback start time (start 
presentation time stamp (SPTS)) of the video data in 
the V08U 85 containing the PCI data. The playback 
start time is the playback start time of the first picture in 
the first GOP in the VOBU 85. Normally, the first picture 
corresponds to 1 picture (intra-picture) data in the MP EG 
standards. The end PTS (VOBU_EPTS) in the VOBU 
85 indicates the playback end time (end presentation 
time starrp (EPTS)) of the video data in the VOBU 85 
containing the PCI data. The playback end time is the 
playback start time of the last picture in the last GOP n 
the VOBU 85. 

The DSI data (DSI) 115 in the DSI packet 117 
shown in FIG. 25 is the navigation data used to search 
for a VOB unit (VOBU) 85. The DSI data (DSf) 1 15 con- 
tains the DSI general information (DSLGI). VOBU 
search information (VOBU_St). and the synchronizing 
playback information (SYNC!) as shown in FIG. 29. 

The DSI information (DSljGI) contains information 
about the entire DSI data 1 1 5. Specifically, as shown in 
FIG. 30. the DSI general information (DSLGI) contains 
the system clock reference for the NV pack 
(NV PCK.SCR) 86. The system dock refererx* 
(NVPCK.SCR) is stored in the system time ctock 
(STC) 54 a! 58 A, 60 A or 62A built in each section of FIG. 
1. On the basis of the STC 54A, 58A, 60A. 62A, video, 
audio, and sub-picture packs are decoded at the video, 
audio, and sub-picture decoders 58, 60, and 62 and the 
monitor 6 and the speaker 8 reproduce images and 
sourd. respectively. The DSI general information 
(DSLGI) contains the start address (NV_PCKJ_BN) of 
the NV pack (NV_PCK) 86 containing the DSI data 
expressed by the number of logical sectors (RLSN)„ rel- 
ative to the first logical sector in the VOB set (VOBS) 82 
containing the DSI, and the address (VOBU_EA) of the 
last pack in the VOB urit (VOBU) 85 containing the DSI 
data expressed by ;the number of logical sectors 
(RLSN), relative to the first logical sector in the VOB unit : 
(VOBU) 85. 

Furthermore, the DSI general information (DSLGI) [ 
contains the end address (VOBUJP_EA) of the V pack 
(V_PCK) 88 containing the last data Hem for the first I 
picture In the VOB unit (VOBU) expressed by the 
number of logical sectors (RLSN). relative to the first 
logical sector in the VOB unit (VOBU) 85 containing the 
DSI data, and the identification number (VOBUJP^EA) 
of the VOB 83 containing the DSI and the identification : 
nurrfcer (VOBU_CJDN) of the cell 84 in which the DSI 
data is recorded. 
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? : The Search information (VOBU_SI) in VOBU 85 
contains information used to identify the first address in 
a cell 84: ; ^ ; 

; ^ the -synchronizing Information (SYNCI) contains 
address information on the sub-pictures and audio data s 
reproduced in synchronization with the playback start 
time of the video data in the VOB unit (VOBU) 85 con- 
taining the DSl data Specifically, as shown in FIG. 31, 
the starts address (A_SYNCA) of the target audio pack 
(A PCK) is expressed by the number of logical sectors 10 
(RLSN), relative to the NV pack (NV_PCK) 86 in which 
DSl data 115 is recorded. When there are more than 
one audio stream (8 audio streams maximum), as many 
pieces of the synchronizing information (SYNCI) as 
there are audio streams are written. Furthermore, the is 
synchronizing information (SYNCI) contains the 
I address (SP_SYNCA) of the NV pack (NV_PCK) 86 of 
the VOB unit (VOBU) 85 containing the target audio 
pack (SP J=>CK) 91 , the address being expressed by the 
number -of logical sectors (RLSN), relative to the NV 20 
pack (NV_PCK) 86 in which DSl 115 is recorded. When 
there are We than one sub-picture stream (32 sub-pic- 
ture streams maximum), as many pieces of the syn- 
chronizing information (SYNC!) as there are sub-picture 
streams are written, j 25 

I Referring to FIG. 32, a sub-picture unit constituted 
of sub-picture data of a plurality of sub-picture packets 
will now be describe. A sub-picture unit as several doz- 
ens of. still picture data (e.g., superimposition) can be 
recorded in one GOP. The sub-picture unit consists of a 30 
sub-picture unit header (SPUH), pixel data (PXD) com- 
prised of run-length data, and a display control 
sequence table (DCSQT). . 

• Described in the sub-picture unit header (SPUH) 
are the size (SPDSZ) of the sub-picture unit and the 35 
start address (SPDCSQTA) of the display control 
sequence table, as shown in FIG. 33. 

*. Display control sequences (DCSQ) are described 
: in a chronological order in the display control sequence 
table (DCSQT) as shown in FIG. 34. *° 

= The start address (SPNDCSQA) and display con- 
trol command (SPDCCMD) of the next display control 
sequence are described in each display, control 
sequence (DCSQ) as shown in FIG. 35. 
? The display control command (SPDCCMD) con- 45 
: slsts of a command (F$TA_DSP) for setting the timing 
for starting the forced-display of pixel data, a command 
(STA DSP) for setting the display start timing for pixel 
data,"a command (STP1DSP) for setting the display end 
timing for pixel data, a command (SETJ30LOR) for set- so 
. ting a color code of pixel data, a command 
(SET_CONTR) for setting the contrast between pixel 
data and main picture/a command (SET_DAREA) for 
setting! the display area for pixel data, a command 
(SET DSPXA) for setting the display start address for ss 
; pixel data, a command (CHG_COLCON) for setting a 
: color change and contrast change in pixel data, and a 
' . command (CMD_END) for terminating the display con- 
trol command. . • j? 



The command (STA^DSP) designates the display 
start time for sub-picture data, and is described by an 
offset PTS from PTS described in a sub-picture packet 
which includes a sub-picture unit header (start PTS). 
The command (STPJ5SP) designates the display stop 
time for sub-picture data, and is described by the offset . 
PTS from PTS described in a sub-picture packet which 
includes a sub-picture unit header (stop PTS). 

The start PTS and stop PTS are delayed by arbi- , 
trary predetermined times from those of main picture 
data and audio data which are reproduced in the same 
timeslot. 

The system processor section 54 shown in FIG. 1 
has a packet discrimination/transfer section 54b, which 
compares the time in an internal STC timer 54a with the 
SCR (System Clock Reference) described in the pack 
header of each pack to discriminate the packet type of a 
matching pack, and sends the data of that packet to 
individual associated sections. The packet data of a 
navigation pack, which has been discriminated by this 
packet discrimination/transfer section 54b, is transferred 
to the data RAM section 56, the packet data of a video 
pack, discriminated by the section 54b, is transferred 
together with an input clock to the video buffer section 
59, the packet data of an audio pack, discriminated by 
the section 54b, is transferred together with an input 
clock to the audio buffer section 61 , and the packet data 
of a sub-picture pack, discriminated by the section 54b, 
is transferred together with an input clock to the sub-pic- 
ture buffer section 63. 

As shown in FIGS. 36A to 36F, for example, when 
data is output packet by packet, the input clock is output 
to the buffer associated with that packet type. 

Accordingly, the system processor section 54 
sequentially outputs sequences of video data, audio 
data and 6ub-picture data, which are to be reproduced 
in the same time slot, together with the input clock to the 
associated buffers. 

The system processor section 54 sends the PTS 
(Presentation Time Stamp) and DTS (Decoding Time 
Stamp), described in the packet header of a video data 
pack, the PTS, described in the packet header of an 
audio data pack, the start PTS and stop PTS, which are . 
specified by the display control command (DCSQ) and 
are included in the PTS, described in the packet header 
of a sub-picture data pack, and the time in the internal 
STC timer 54a or the SCR to the buffer control/STC 
control section 57, 

The buffer control/STC control section 57 is 
designed to store the SCR from the system processor 
section 54 into an STC timer 57a. outputs the SCR and 
the PTS and DTS of each data to the associated decod- 
ers, and outputs an output clock to the buffers associ- 
ated with the PTS and DTS/ 

For example, one unit of output clocks as shown in 
FIG. 36H is output to the video buffer section 59 in 
accordance with the DTS for video data as shown in 
FIG. 36G, one unit of output clocks as shown in FIG. 
36J is output to the audio buffer section 61 in accord- 
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ance with the PTS for audio data as shownin FIG. 361. • 
and one unit of output clocks as shown in FIG. 36L is 
output to the sub-picture buffer section 63 in accord- 
ance with the start PTS for sub-picture data as shown in 
FIG.36K. = | I 5 

Each of the video buffer section 59, audio buffer : 
section 61 and sub-picture buffer section 63 shown in 
FIG. 1 is an FIFO (First In First Out) memory which is a 
ring buffer comprised of FF circuits, as shown in FIG. 

37. If the capacity of this FIFO memory is set to approx- to 
imately 10 times the VOBU (Video Object) recorded on . 
the optical disk 1 0. data for several seconds to ten sec- 
onds can be retained. The FIFO memory stores data, 
supplied from the system processor section 54, in 
accordance with input data that is simultaneously sup- * 5 
plied, and outputs the stored data in response to the ; 
output clock supplied from the buffer control/STC con- ! 
trol section 57. | 

The video decoder section 58 shown in FIG. 1 com- 
prises an STC timer 58a. registers' 58b and 58c. compa- zo 
rators 58d and 58e. and a decoder 58f. as shown in FIG. 

38. The SCR set by the buffer control/STC control sec- 
tion 57 is stored in the STC timer 58a and the time 
therein is updated by a clock. The register 58b retains 
the DTS for video data which is set by the buffer con- 25 
trol/STC control section 57. The register 58c retains the . 
PTS for video data which is set by the buffer con- 
trol/STC control section 57. The comparator 58d com- 
pares the STC in the STC timer 58a with the DTS in the 
register 58b to check if they match with each other. The 30 
comparator 58e compares the STC In the STC timer 
58a with the PTS in the register 58c to check If they 
match with each other. The decoder 58f decodes the 
video data input from the video buffer section 59 in 

, accordance with the output of the comparator 58d and 35 
outputs the decoding result to the mixing section 64 in 
accordance with the output of the comparator 58d. 

The audio decoder section 60 shown in FIG. 1 com- 
prises an STC timer 60a, a register 60b. a comparator 
60c, and a decoder 60d. as shown in FIG. 39. The SCR to 
set by the buffer control/STC control section 57 Is stored 
In the STC timer 60a and the time therein is updated by 
a clock. The register 60a retains the PTS for audio data 
which is set by the buffer control/STC control section 57. 
The comparator 60c' compares the STC in the STC 45 

• timer 60a with the PTS in the register 60b to check if 
they match with each other. The decoder 60d decodes 
the audio data input from the audio buffer section 61 in 
accordance with the output of the comparator 58d when 
a match is made, and outputs the decoding result to the so 
audio D/A section 68. I 

The sub-picture decoder section 62 shown in FIG. 1 
comprises an STC timer 58a. registers 62b and 62c. 
comparators 62d and 62e. and a decoder 62f. as shown 

: in FIG. 40. The SCR set by the buffer control/STC con- ss 
trol section 57 is stored in the STC timer 62a and the 

! time therein is updated by a dock. The register 62b 
retains the start PTS for sub-picture data which is set by 

: the buffer control/STC control section 57. The register 
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62c retains the stop PTS for sub-picture data wNcft is 
set by the buffer control/STC control section 57. The 
comparator 62d compares the STC in the STC timer 
62a with the start PTS in the register 62b to check if they 
match with each other. The comparator 62e compares 
the STC in the STC timer 62a with the stop PTS m the 
register 62c to check if they match with each other. The 
decoder 62f starts decoding the sti>-picture data input 
from the sub-picture buffer section 63 in accordance 
with the output of the comparator 62d when there is a 
match, and outputs the decoding result to the mixing 
section 64 in accordance with the output of thecompa- 
rator 62d when there is a match. 

Referring again to FIG. 1. a description wtil now be 
given of the operation of reproducing movie data on 
English conversations for learning English, from the 
optical disk 10 which has the logical format shown h 
FIGS. 4 to 31. 

When the optical disk apparatus shown in FIG. 1 b 
powered on and the optical disk 10 where marie data 
for English conversations for learning English is 
recorded is loaded, the system CPU section 50 reads 
the realization program from the system ROM and 
RAM section 52, and activates the risk drive section 30. 
Therefore, the disk drive section 30 starts reading the 
lead-in area 27 and reads the volume and file structure 
area 70, which follows the lead-in area 27 and defines 
the volume and file structure in conform to ISO9660 or 
the like. More specifically, to read the vdume and file 
structure area 70 recorded at a predetermined position 
on the disk 10 set in the cfisk drive section 30. the ays- 
tern CPU section 50 sends a read command to the disk 
drive section 30 to read the contents of the volume and 
file structure area 70 and temporarily stores the con- 
tents in the data RAM section 56 via the system proces- 
sor section 54. The system CPU section 50 extracts 
information on the recorded position, recording capac- 
ity, size or the like of each file and other necessary man- 
agement information via the pass tatte and directory 
record stored in the data RAM section 56, transfers the 
extracted information at predetermined positions in the 
system ROM and RAM section 52 and saves the infor- 
mation there. 

Next, the system CPU section 50 refers to informa- 
tion on the recorded position and recording capacity of 
each f fle from the system ROM and RAM section 52 to 
acquire a video manager 71 , which consists of a plural- 
ity of files starting with a f 3e number 0. That is, referring 
to the information on the recorded position and record- 
ing capacity of each file acquired from the system ROM 
and RAM section 52. the system CPU section 50 sends 
a read command to the dsk drive section 30 to obtain 
the positions and sizes of a plurality of f3es which con- 
stitute the video manager 71 existing on the root drec- 
tory, reads this video manager 71 and stores the 
acquired information into the data RAM section 56 via 
the system processor section 54. A volume manager 
information management table (VMGI_MAT) 78. which 
is the first table in this video manager 71. is searched. 
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Through; this search, the start : address 
(VMGM_VOBS_SA) of a video object set 
(VMGM VOBS) 76 for a video manager menu (VMGM) 
is acqui~ed and the video object set (VMGM.VOBS) 76 ; 
is reproduced, As the procedures for reproducing this 
video object set (VMGMjfOBS) 76 for the video man- 
ager menu are the same as those for the video object 
set (VTSM_VOBS) for a title in the video title set (VTS). 
their description will not be repeated. When a language 
is set in the video object set (VMGM_VOBS) 76 or when 
there is ho video manager menu (VMGM), the volume 
manager information management table (VMGI_MAT) 
78: is searched to, acquire the start address 



of a 



title search pointer table 



(TT_SRPT_SA) 
(TT_SRPT) 79- 

, : j Through this search! the title search pointer table 
(Tf SRPT) 79 is transferred to a predetermined posi- 
flonV tw system ROM and RAM section 52 to be 
saved there. Next, the system CPU section 50 acquires 
the end address of the title search pointer table 
(TT SRPT) 79 from title search pointer table informa- 
tiorT(TSPTI) 92 and acquires the video title set number 
(VTSN), program chain number (PGCN) and the start 
address (VTS SA) of the video title set, which are asso- 
ciated with a number entered from the key/display sec- 
tion 4, from a title [search pointer (TT.SRP) 93 
according to that input number. When there is only one 
title set one title search pointer (TT_SRP) 93 is 
searched to acquire the start address (VTS_8A) of that 
title set, Irrespective of whether or not there is an input 
number torn the key/display section 4. The system 
CPU section 50 acquires the target title set from the 
start address (VTS_SA) of this title set. 
: , The system CPU section 50 acquires the number of 
streams of the video, audio and sub-picture data for the 
volume menu arid their attribute information, described 
in the volume manager information management table 
(VMGI MAT) 78 in a volume manager (VMGI) 75. and 
sets parameters tor reproducing the video manager 
menu in the associated video decoder section 58. audio 
decoder section 60 and sub-picture decoder section 62 
based on the attribute Information. 

1 Next, as shown in FIG. 12. video title set Informa- 
tion (VTSI) 94 of the title set is acquired from the start 
address (VTS_SA) ol a video title set 72. From a video 
title set information management table (VTSI_MAT) 98 
in this video title set information (VTSI) 94, the end 
address (VTI MAT_EA) of the video title set information 
managementtable (VTSLMAT) 98 shown in FIG. 13 is 
acquired. Based oa the number of streams 
(vTS.ASTJfc, VTS_SPST_Ns) of audio data and sub- 
picture data and the attribute information (VTS_V_ATR, 
VTS A - ATR. VTS_SPST_ATR) of the video, audio and 
sub-picture data, the individual sections of the repro- 
ducing apparatus shown In FIG. 1 are set according to 
their attributes.. • • ■'. \ . „« 
! Cell playback information (C.PBI) shown in FIG. 21 
is' acquired from a start address (C..POSIT..SA), and 
the start address (C_FVOBU_SA) of the first VOBU 85 



and the start address (C_LVOBU_SA) of the last VOBU 
in the cell shown in FIG. 22, which are described in the 
playback information (C_PBI). are acquired to search 
for the target cell. The cell playback order is determined 
5 in such a way that playback cells 84 are determined one 
by one by referring to the program map shown in FIG. 
19 in a PGC program map (PGC.PGMAP) 106 shown 
in FIG. 17. The data cells 84 of the program chain, 
determined in this manner, are sequentially read from a 
, 0 video object 1 44 and are Input to the data RAM section 
56 via the system processor section 54. The system 
processor section 54 sends each data cell 84 via the 
individual buffer sections 59, 61 and 63 to the video 
decoder section 58. audio decoder section 60 and sub- 
, 5 picture decoder section 62 to be decoded based on the 
DTS as decode time information and the PTS as play- 
back time information. The video data and sub-picture 
data are mixed In the mixing section 64, after which the 
resultant data is converted to a video signal by the video 

so D/A section 66 to reproduce an image on the monitor 
section 6. The audio data is converted to an audio sig- 
nal by the audio D/A section 68 which is sent to the 
speaker section 8 for sound reproduction. 

At this time, the superimposition as sub-picture. 
25 data is mixed with main picture data to be displayed 
when a predetermined time elapses after the display of 

the main picture data. 

The reproduction of video data will be described 
more specifically, with reference to the flowchart illus- 
30 tratedinFIG.41. 

In the reproduction of video data, when playback 
starts at step S1 1 as shown in FIG. 41 , the system CPU 

section 50 searches the volume manager (VMGI) 75 
and stores it in the system ROM and RAM section 52 in 
35 step S12 as has already been discussed above. Uke- 
wise. the video title set information (VTSI) 94 ol the 
video title set (VTS) 72 is read based on this volume 

manager (VMGI) 75. and the video title set menu is dis- 
played on the monitor section 6 using its video object 
40 set (VTSM VOBS) 95. Based on this display, the title 
set 72 to be reproduced and the playback conditions or 
the like are determined by a user as indicated In step 
S13. When the determined title set 72 Is selected using 
the key/display section 4. the system CPU section 50 
as reads data of a cell playback information table (C_PBIT) 
107. shown in FIGS. 17, 21 and 22. from a program 
chain information (VTS_PGCIT) 100 shown in FIG. 12 
in the selected title set 72 and stores the data in the sys- 
tem ROM and RAM section 52 as indicated in step Si 4. 
so In accordance with the playback conditions entered 
from the key/display section 4. the system CPU section 
":■ 50 determines the program chain number 
(VTS_PGC_Ns) for starting playback, the audio stream 
number and sub-picture stream number, as indicated in 
55 step S15. For example, lessen 1 ol the English conver- 
sation for learning English is selected as a title, and dis- 
playing superimposition as a sub-picture is determined. 
The determined sub-picture number and audio stream 

number are set in the register (not shown) In the system 
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processor section 54 as indicated n step S1 6. Likewise, 
the playback start time is set in the system clock (STC) 
timers 54a, 57a. 58a, 60a and 62a in the system proc- 
essor section 54. buffer control/STC control section 57, 
video decoder section 58 and audio decoder section 60 
and sub-picture decoder section 62. Further, the start 
address of the first VOBU in a cell as the start address 
and the PGC number or cell number are stored in the 
system ROM and RAM section 52. 

As indicated in step S17. the system CPU section 
50 sends a read command to the disk drive section 30 
when it is ready to read the video title set. and the disk 
drive section 30 seeks the optical disk 10 based on the 
aforementioned start address. In response to the read 
command, cells associated with the specified program 
chain (PGC) are sequentially read from the optical disk 
. 1 0. and are sent to the data RAM section 56 via the sys- 
tem CPU section 50 and system processor section 54. 
The transferred cell data is stored in the data RAM sec- 
tion 56 pack by pack/ starting from navigation pack 86 
as the head pack of the video object unit (VOBU) 85 as 
shown in FIG. 6. Thereafter, the system processor sec- 
tion 54 and buffer control/STC control section 57 distrib- 
ute the video data of the video pack 88 of the video 
object unit (VOBU) to the video decoder section 58 via 
the video buffer section 59. distribute the audio data of 
the audio pack 91 to the audio decoder section 60 via 
the audio buffer section 61, and distribute the sub-pic- 
ture data of the sub-picture pack; 90 to the sub-picture 
decoder section 62 via the sub-picture buffer section 63. 
The video data decoded by the video decoder section 
58 and the sub-picture data decoded by the sub-picture 
decoder section 62 are mixed by the mixing section 64, 
and the mixed data is sent to the video D/A section 66. 
The audio data decoded by the audio decoder section 
60 is sent to the audio D/A section 68. Consequently, a 
video signal is sent to the monitor section 6 and an 
audio signal is sent to the speaker section 8. so that the 
video display and audio playback; will start After a pre- 
determined period of time, the sub-picture Is superim- 
posed on the display.!: j | 

When the playback is complete In step S18, or 
when the end PTS (VOBU_EPTS) described in general 
information (PCLGI) of the PCM 13 is referred to and 
this end PTS (VOBU_EPTS) matches with the system 
time clock (STC) as indicated in step S18, the screen 
display on the monitor section 6 is stopped as indicated 
in step S19. Then, the system CPU section 50 sends a 
data transfer stop command to the disk drive section 30 
to stop data transfer, terminating the playback operation 
as indicated in step S20. j 

This playback process will be described more spe- 
cifically with reference to the timing chart shown in 
FIGS. 36A through 36H and the flowchart illustrated in 

FIG. 42. I' | ■ 

As indicated in step S31 . the system processor sec- 
tion 54 sequentially reads the pack data, which is to be 
. reproduced in the same time slot as the playback time 
set in the STC timer 54a. from tta data RAM section 56 



by referring to the SCR given to the pack header, deter- 
mines the packet type described in the packet header in 
that pack, and sends the packet data determined as the 
main picture to the video buffer section 59 as video 
5 data, the packet data determined as the audio data to 
the audio buffer section 61 as audio data, and the 
packet data determined as the sub-picture to the sub- 
picture buffer section 63 as subpicture data in accord- 
ance with the determined packet type. 
to As depicted in step S32. the system processor sec- 
tion 54 sends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS. descrtoed in the 
packet header of the head pack of the video data, the 
PTS. described in the packet header of the head pack of 
15 the audio data, and the start PTS and stop PTS, which 
are specified by the display control command (DCSQ) 
.and are included in the PTS, descrtoed in the packet 
header of the head pack of the sub-picture data, to the 
buffer control/STC control section 57. 
so The buffer control/STC control section 57 sets the 
supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 53, the STC timer 6Ca of 
the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as specified in step S33. 
25 Further the buffer control/STC control sect' on 57 
outputs the input clock to the video buffer section 59 
when packet data of the video data is sent to the video 
buffer section 59 from the system processor section 54. 
outputs the input dock to the audio buffer section 61 
30 when the packet data of the audio data is sent to the 
audio buffer section 61 from the system processor sec- 
tion 54. and outputs the input dock to the sub^cture 
buffer section 63 when the packet data cf the sub-pic- 
ture data is sent to the sub-picture buffer section 63 
35 frcm the system processor section 54. 

. As a result, the video buffer section 59, audio buffer 
section 61 and sub-picture buffer section 63 store the 
supplied data in response to the input clock as 
described in step S34. 
40 When the STC in the STC timer 57a matches with 
the DTS of the video data, the buffer contrd/STC control 
section 57 outputs one unit of output docks to the wleo 
buffer section 59. When the STC in the STC tirm ?£a 
in the video decoder section 58 matches with the D ?0 r i 
45 the register 58b. the decoder 58f starts decoding oased 
on the output of the comparator 58d. 

Consequently, the video data output from the video 
buffer section 59 in accordance with the output dock fe 
decoded by the decoder 58f as indicated in step S35. 
so As is apparent from step S36, when the STC in the 
STC timer 58a in the video decoder section 58 matches 
with the PTS in the register 58c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 
the mixing sedion 64 based on the output from the com- 
55 parator58e. 

When the STC in the STC timer 57a matches with 
the PTS in the audio da!a, the buffer control/STC control 
section 57 outputs one unit of output docks to the audto 
buffer sedion 61. When the STC in the STC timer 60a 
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in the audio decoder section 60 matches with the PTS in 
the register 60b, the decoder 60d also starts decoding 
based on the output of the comparator 60c . 
. t Consequently, as depicted in 6tep S37, the audio 
data output from the audio buffer section 61 in accord- 75 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
D/A section 68.' 

• After a predetermined time has passed, i.e., when 
the STC in the STC timer 57a matches with the start io. 
PTS of the sub-picture data, the buffer control/STC con- 
trol section 57 outputs one unit of output clocks to the 
sub-picture buffer section 63. When the STC In the STC 
timer 62a in the sub : plcture decoder section 62 
matches with the start PTS in the register 62b, the 15 
decoder 62f starts decoding based on the output of the 
comparator 62d. j- | 

- : : Consequently, as specified in step S38, the sub- 
picture data output from' the sub-picture buffer section 
63 in accordance with the output clock is decoded by so 
the decoder 62f and the'decoded output is then mixed 
with the video data in the mixing section 64. The result- 
ant data is then sent to the video D/A section 66. 

( When the STC in the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the stop PTS in 25 
the register 62c. the decoder 62f stops decoding based ' 
on the output of the comparator 62e. 

:' Accordingly, as indicated in step S39, the decoder 
621 in the sub-picture decoder section 62 stops output- 
ting the decoded data. , 30 

I Consequently, the Jmage corresponding to the 
video data is displayed oh the monitor section 6 and the 
voice corresponding to;the audio data is reproduced 
from the speaker section 8. After a predetermined time 
delay, the mixed image corresponding to the sub-picture 3S 
data and video data is displayed on the monitor section 
6. Thereafter, the sub-0icture data will disappear. 

I At the first timing, therefore, the image of a teacher : 
pronouncing "ONE* is displayed as the main picture on 
the monitor section 6 and the teacher's voice "ONE" is 40 
reproduced from the speaker section 8, as shown In 
FIG. 43A. At the next timing, as shown In FIG. 43B, the 
image of the teacher saying "ONE" is displayed as the 
main picture on the monitor section 6 and the superim- 
position "ONE" as the sub-picture is superimposed on 45 
the main picture. At this timing, an apprentice as a lis- 
tener should pronounce the word. At the next timing, as 
shown in FIG. 43C, the image of the teacher saying 
"GOOD" is displayed as the main picture on the monitor 
section 6 and the teacher's voice "GOOD* is repro- so 
duced from the speaker section 8. 

i- As a result, the sub-picture which is to be displayed 
at the same time as the reproduction of the normal voice 
is delayed or the sub^icture is displayed with a some 
delay. In learning a language, for example, a listener ss 
can listen first without any hint and then confirm it later. 

: The second embodiment of this invention will now 
be described, centering on the modif ied parts which dif- 



fer from the first embodiment, with reference to FIGS. 
43A to 43C and FIGS. 44 to 46. 

According to the second embodiment, the delay 
' time Td for delaying sub-picture data is preset in the 
reproducing apparatus. 

In this embodiment, the start PTS described in the 
sub-picture unit as sub-picture data on the optical disk 
10 is the same as the PTS's of video data and audio 
data which are to be processed in the same time slot 
FIG. 44 presents a block diagram of an optical disk 
: reproducing apparatus for explaining the second 
. embodiment. 

The delay time Td for delaying sub-picture data is 
previously stored In the system ROM and RAM section 
52 or the internal memory (not shown) of the system 
CPU section 50. Accordingly, the delay time Td read 
from the system ROM and RAM section 52 by the sys- 
tem CPU section 50 is supplied to the buffer con- 
trol/STC control section 57. 

FIGS. 45A through 45M show a timing chart for 
explaining the relationship among an input clock, output 
clock, PTS and DTS for use in the reproduction of video 
data, audio data and sub-picture data. FIGS. 45A-45J 
are identical to FIGS. 36A through 36J. 

The buffer control/STC control section 57 sends the 
start PTS and stop PTS with respect to the sub-picture 
data, supplied from the system processor section 54, to 
the sub-picture decoder section 62 with the delay time 
Td, and also delays one unit of output clocks to be 6ent 
to the sub-picture buffer section 63 by the delay time Td. 

The start PTS and stop PTS for the sub-picture 
data supplied from the system processor section 54 are 
shown in FIG. 45K, the start PTS and stop PTS for the 
sub-picture data, which are to be delayed by the delay 
time Td, are shown in FIG. 45L and one unit of output 
clocks for the siib-picture data, which are to be delayed 
by the delay time Td, are 6hown in FIG. 45M. 

Tbe playback operation of this structure will new be 
discussed referring to the timing chart shown in FIGS. 
45A-45M and the flowchart illustrated in FIG. 46. 

As Indicated In step S41 , the system processor sec- 
tion 54 sequentially reads the pack data, which is to be 
reproduced in the same time slot as the playback time 
set in the STC timer 54a, from the data RAM section 56 
by referring to the SCR given to the pack header, deter- 
mines the packet type described in the packet header in 
that pack, and sends the packet data determined as the 
main picture to the video buffer section 59 as video 
data, the packet data determined as the audio data to 
the audio buffer section 61 as audio data, and the 
packet data determined as the sub-picture to the sub- 
picture buffer section 63 as sub-picture data in accord- 
ance with the determined packet type. 

As depicted in step S42, the system processor sec- 
tion 54 sends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS, described in the 
packet header of the head pack of the video data, the 
PTS, described in the packet header o1 the head pack of 
the audio data, and the start PTS and stop PTS, which 
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are specified by the display control command (DCSQ) 
and are included in the PTS. described In the packet 
header of the head pack of the sub-picture data, to the . 
buffer contro!/STC control section. 57. The system CPU 
section 50 supplies the delay timeTd for the sub-picture 5 
data, read from the system ROM and RAM section 52, 
to this buffer control/STC control section 57. 

The buffer control/STC control section 57 sets the 
supplied SC R as the playback time in the STC timer 58a 
of the video decoder section 58, the STC timer 60a of to 
the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as specified in step S43. 

Further, the buffer control/STC control section 57 
outputs the input clock to the video buffer section 59 
when packet data of the video data is sent to the video 
buffer section 59 from the system' processor section 54, 
outputs the input clock to the audio buffer section 61 
when the packet data of the audio data Is sent to the 
audio buffer section 61 from the system processor sec- 
tion 54, and outputs the input dock to the sub-picture 
buffer section 63 when the packet data of the sub-pic- 
ture data is sent to the sub-picture buffer section 63 
from the system processor section 54. i 

As a result, the video buffer section 59. audio buffer 
section 61 and sub-picture buffer section 63 store the 25 
supplied data in response to the input clock as indicated 
instepS44. j ■ ' j 

When the STC in the STC timer 57a matches with 
the DTS of the video data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the video 
buffer section 59. When the STC in the STC timer 58a 
in the videodecoder section 58 matches with the DTS in 
the register 58b, the decoder 58f starts decoding based 
on the output of the comparator 58d. 

Consequently, the video data output from the video 35 
buffer section 59 in accordance with the output clock is 
decoded by the decoder 58f as described in step S45. 

As is apparent from step S46, when the STC In the 
STC timer 58a in the video decoder section 58 matches 
with the PTS in the register 53c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 
the irixing section 64 based on the output from the com- 
parator 58e. | : ; .. 

When the STC in the STC timer 57a matches with 
the PTS in the audio data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the audio 
buffer section 61 . When the STC in the STC timer 60a 
in the audio decoder section 60 matches with the PTS in 
the register 60b. the decoder 60d also stale decoding 
based on the output of the comparator 60c. 

Consequently, as depicted in step S47, the audio 
data output from the audio buffer section 61 in accord- , 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
D/A section 68. ! : ! » 

After a predetermined time has passed, i.e.. when 
the delay time Td elapses after the matching of the STC 
in the STC timer 57a with the start PTS of the sub-pic- s 
ture data, the buffer controVSTC control section 57 out- 
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puts one unit of output docks to the sub-picture buffer 
section 63. When the STC in the STC timer 62a in the 
sub-picture decoder section 62 matches with the start 
PTS delayed by the delay time Td in the register 62b, 
the decoder 62f starts decoding based on the output of 
the comparator 62d. ; 1 

Consequently, as indicated in step S48, the sub- 
picture data output from the sub-picture buffer section 
63 in accordance wtth the output clock is decoded by 
the decoder 62f and the decoded output is then mixed 
with the video data in the mixing section 64. The result- 
ant data is then sent to the video D/A section 66. 

When the STC in the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the step PTS 
delayed by the delay time Td in the register 62c. the 
decoder 62f stops decoding based on the output of the 
comparator 62 e. 

Accordingly, as specified in step S49, the decoder 
62f in the subpicture decoder section 62 stops output- 
ting the decoded data. 

Consequently, the image corresponding to the 
video data is displayed on the monitor section 6 and the 
voice corresponding to the audio data is reproduced 
from the speaker section 8. After a predetermined time 
delay, the nixed image corresponding to the sub-picture 
data and video data is displayed on the monitor section 
6. Thereafter, the sub-picture data will disappear. 

At the first timing, therefore, the image of a teacher 
saying 'ONE* is displayed as the main picture on the 
monitor section 6 and the teacher's voice •ONE* is 
reproduced from the speaker section 8, as shown in 
FIG. 43A. At the next timing, as shown in FIG. 43B, the 
image of the teacher pronouncing •ONE" is dsplayed as 
the main picture on the monitor section 6 and the super- 
inrposition "ONE" as the sub-picture is superimposed 
on the main picture. At this timing, an apprentice as a 
listener should pronounce the word. At the next timing, 
as shown in FIG. 43C, the image of the teacher saying 
"GOOD - is displayed as the main picture on the monitor 
section 6 and the teachers voice "GOOD" is repro- 
duced from the speaker section 8. 

The third embodiment of this invention will now be 
discussed with reference to FIGS. 43A through 43C, 
FIG. 44. FIGS. 45A through 45M # and FIGS. 47A. 47B 
and 48. The delay time at which the subpicture data is 
reproduced with respect to the main picture data is pre- 
set in the reproducing apparatus in the second embed- 
ment, whereas a user can freely set the delay lime 
using the key/display section 4 and what is displayed on 
the monitor section 6 in the third embodiment. The 
key/display section 4 may be. constituted of a remote 
controller, tor example. 

For instance, the basic menu screen tor setting the 
delay time as shewn in FIG. 47A is displayed on the 
monitor section 6. and a user selects "DELAY SET" for 
setting the delay time from among the selections 
TITLE," "LANGUAGE" and "DELAY SET" on the basic 
menu screen using the keyAJisplay section 4. Then, the 
delay time setting screen as shown in FIG. 47B is a s- 
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played on the monitor section 6. Using the key/display 
section 4, the user selects, for example, "SUB-PIC* 
TURE" from "VIDEO,* "AUDIO" and "SUB-PICTURE" 
on the delay time setting screen, as the type for which 
the delay time is to be set, and then sets the delay time 
(seconds) through the time setting section on that 
screen.- | } ■ 

^ The playback operation of this structure will now be 
discussed referring to the timing chart shown in FIGS. 
45A-45M and the flowchart illustrated in FIG. 48. 

: First, the basic menu screen for setting the delay 
time as shown in FIG. 47A is displayed on the monitor 
section 6 as indicated 'In step S50. The user then 
selects "DELAY SET" for setting the delay time from 
among "TITLE," "LANGUAGE" and "DELAY SET" on 
the basic menu screen using the key/display section 4 
as indicated instep S51.: 

u Consequently, the time setting screen for each type 
to be delayed (hereinafter referred to as "type-by-type 
delay time setting screen") as shown in FIG. 47B is dis- 
played oh the monitor section 6 as indicated in step 
S52. Then, using the key/display section 4, the user 
selects/for example, "SUB-PICTURE" from among 
"VIDEO," "AUDIO" and "SUB-PICTURE" on the type- 
by-type delay time setting screen, as the type for which 
the delay time is to be set, and then sets the delay time 
(seconds) through the time setting section on that 
screen as depicted in step S53. 

• Then, as indicated in step S54, the system proces- 
sor section 54 sequentially reads the pack data, which 
is to be reproduced in the same time slot as the play- 
back time set in the STC timer 54a, from the data RAM 
section 56 by referring to the SCR given to the pack 
header, determines the packet type described in the 
packet header in that pack, and sends the packet data 
determined as the main picture to the video buffer sec* 
tioh 59 as video data, the packet data determined as the 
audio data to the audio buffer section 61 as audio data, 
and the packet data determined as the sub-picture to 
the sub-picture buffer section 63 as sub-picture data in 
accordance with the determined packet type. : 

: As depicted in step S55, the system processor sec- 
tion 54 sends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS, descrbed in the 
packet header of the head pack of the video data, the 
PTS, described in the packet header of the head pack of 
the audio data, and the start PTS and stop PTS, which 
are specified by the display control command (DCSQ) 
and are included in the PTS, described in the packet 
header of the head pack of the sub-picture data, to the 
buffer control/STC control section 57. The system CPU 
section 50 supplies the type targeted tor the delay, set 
by the key/display section 4, the delay time Td for the 
sub-picture data, read from the system ROM and RAM 
section 52, to this buffer control/STC control section 57. 

The buffer control/STC control section 57 sets the 
supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 58, the STC timer 60a of 



the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as specified in step S56. 

Further, the buffer control/STC control section 57 
outputs the input clock to the video buffer section 59 
5 when packet data of the video data is sent to the video 
buffer section 59 from the system processor section 54, 
outputs the input clock to the audio buffer section 61 
when the packet data of the audio data is sent to the 
audio buffer section 61 from the system processor see- 
to tion 54, and outputs the input clock to the sub-picture 
buffer section 63 when the packet data of the sub-pic- 
ture data is 6ent to the sub-picture buffer section 63 
from the system processor section 54. 

As a result, the video buffer section 59, audio buffer 
15 section 61 and sub-picture buffer section 63 store the 
supplied data in response to the input clock as indicated 
instepS57. 

When the STC in the STC timer 57a matches with 
the DTS of the video data, the buffer control/STC control 

so section 57 outputs one unit of output clocks to the video 
buffer section 59. When the STC in the STC timer 58a 
in the video decoder section 58 matches with the DTS in 
the register 58b, the decoder 58f starts decoding based 
on the output of the comparator 58d. 

25 Consequently, the video data output from the video 
buffer section 59 in accordance with the output clock is 
decoded by the decoder 58f as described in step S58. 

As is apparent from step S59, when the STC in the 
STC timer 58a in the video decoder section 58 matches 

so with the PTS in the register 58c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 

v the mixing section 64 based on the output from the com- 
parator 58e. 

When the STC in the STC timer 57a matches with 

35 the PTS in the audio data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the audio 
buffer section 61. When the STC in the STC timer 60a 
in the audio decoder section 60 matches with the PTS in 
the register 60b, the decoder 60d also starts decoding 

40 based on the output of the comparator 60c. 

Consequently, as depicted in step S60. the audio 
data output from the audio buffer section 61 in accord- 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 

45 . D/A section 68. 

After a predetermined time has passed, i.e., when 
the delay time Td elapses after the matching of the STC 
■ in the STC timer 57a with the start PTS of the sub-pic- 
ture data, the buffer control/STC control section 57 out- 

50 puts one unit of output clocks to the sub-picture buffer 
section 63. When the STC in the STC timer 62a in the 
sub-picture decoder section 62 matches with the start 
PTS delayed by the delay time Td in the register 62b, 
the decoder 62f starts decoding based on the output of 

55 the comparator 62d. 

Consequently, as indicated in step S61, the sub- 
picture data output from the sub-picture buffer section 
63 in accordance with the output clock is decoded by 
the decoder 62f and the decoded output is then mixed 
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with the video data in the mixing section 64. The result- 
ant data is then sent to the video D/A section 66. j 

When the STC in the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the stop PTS 
delayed by the delay time Td in the register 62c. the 
decoder 62f stops decoding based on the output ol the 
comparator 62e. | i. 

Accordingly, as specified in step S62, the decoder 
62f in the sub-picture decoder section 62 stops output- 
ting the decoded data! I 

Consequently, the image corresponding to the 
video data is displayed on the monitor section 6 and the 
voice corresponding to the audio data is reproduced 
from the speaker section 8. After a predetermined time 
delay, the mixed image corresponding to the sub-picture 
data and video data is displayed on the monitor section 
6. Thereafter, the sub-picture data will disappear, j 

At the first timing, therefore, the Image of a teacher 
saying "ONE* is displayed as the main picture on the 
monitor, section 6 and the teacher's voice "ONE" is 
reproduced from the speaker section 8. as 6hown in 
FIG. 43A. At the next timing, as shown In FIG. 43B, the 
image of the teacher pronouncing fONE" is displayed as 
the main picture on the monitor section 6 and the super- 
imposition "ONE" as the sub-picture is superimposed 
on the main picture. At this timing, an apprentice as a 
listener should pronounce the word. At the neixt timing, 
as shown in FIG. 43C. the image 'of the teacher saying 
"GOOD" is displayed as the main picture on the monitor 
section 6 and the teacher's voice "GOOD" is repro- 
duced from the speaker section 8. j 

Although the foregoing description of this embodi- 
ment has been given with reference to the case where 
sub-picture data is delayed, this invention may also be 
adapted to the case where main picture data or audio 
data is delayed. i \' 

The fourth embodiment of this invention wilt now be 
described referring to FIG. 1, FIGS. 49A through 49N. 
FIG. 50 and FIGS. 51 A through 51 C. According to the 
fourth embodiment, by utilizing the tact that the display 
period of a sub-picture which Is expressed by using the 
start PTS and stop PTS of a sU>-picture unit corre- 
sponds to one phrase of the normal speech, the display 
timing of a sub-picture is delayed by one phrase and 
during the display of this sub-picture, the main picture 
and voice are stopped or frozen, j ■ 

In this embodiment, the start PTS described in the 
6ub-picture unit as sub-picture data on the optical disk 
10 is the same as the PTS's of video data and audio 
data which are to be processed in the same time slot. 

FIGS. 49A through 49M show a timing chart for 
explaining the relationship amongan input clock, output 
clock. PTS and DTS for use in the reproduction of video 
data, audio data and sub-picture'data. FIGS. 49A-49F 
are identical to FIGS. 36A through 36F. j 

The buffer control/STC control section 57 delays 
the start PTS and stop PTS with inspect to the sub-pic- 
ture data, supplied from the system processor section 
54, by the delay time Td corresponding to one phrase 



computed from the difference between the start PTS 
and stop PTS. and outputs the delayed start PTS and 
stop PTS to the sub-picture decoder section 62, and 
also delays one unit of output clocks to be sent to the 

5 sub-picture buffer section 63 by the delay time Td. 

The start PTS and stop PTS for the sub-picture 
data supplied from the system processor section 54 are 
shown in FIG. 49K, the start PTS and stop PTS for the 
sub-picture data, which are to be delayed by the delay 

10 time Td. are shown in FIG. 49L and one unit of output 
docks for the sub-picture data, which are to be delayed 
by the delay time Td, are shown in FK3L49M. i 

During the period from the start PTS for the sub- 
picture data output with the delay time Td to the stop 

is PTS. the buffer control/STC control section 57 outputs a 
stop signal to the STC timer 58a in the video decoder 
section 58 and the STC timer 60a in the aucf o decoder 
section 60. 

In other words, the buffer controt/STC control sec- 

20 tion 57 stops the STC timers 58a and 60a in accordance 
wfth the start PTS delayed by the delay time Td, and 
sets the time leading by the delay time Td from the STC 
corresponding to the start PTS delayed by the delay 
time in the STC timers 58a and 60a in accordance with 

25 the stop PTS. 

While a sub-picture is being displayed, freezing the 
video and audio data is carried out 

The playback operation of this structure wtli now be 
discussed referring to the timing chart shown in FIGS. 

30 49A-49N and the flowchart illustrated in FIG. 50. 

As indicated in step S71 . the system processor sec- 
tion 54 sequentially reads the pack data, which is to be 
reproduced in the same time slot as the playback time 
set in the STC timer 54a, from the data RAM section 56 

35 by referring to the SCR given to the pack header, deter- 
mines the packet type described In the packet header in 
that pack, and sends the packet data determined as the 
main picture to the video buffer section 59 as video 
data, the packet data determined as the audio data to 

40 the audio buffer section 61 as audio data, and the 
packet data determined as the sub-picture id the sub- 
picture buffer section 63 as sub-picture data in accord- 
ance with the determined packet type. 

As indicated in step S72. the system processor sec- 

45 tion 54 sends the time set in the STC timer 54a (SCR as 
the playback time), the DTS and PTS. descrfaed h the 
packet header of the head pack of the video data, the 
PTS, described in the packet header of the head pack of 
the audio data, and the start PTS and stop PTS. which 

so are specified by the display control command (DCSQ) 
and are included in the PTS. descrbed in the packet 
header of the head pack of the sub-picture data, to the 
buffer control/STC control s ection 57. 

The buffer controt/STC control section 57 sets the 

55 supplied SCR as the playback time in the STC timer 58a 
of the video decoder section 58. the STC timer 60a of 
the audio decoder section 60 and STC timer 62a of the 
sub-picture decoder section 62 as indicated in step S73. 
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■ \ The buffer control/STC control section 57 computes 
the delay time Td corresponding to one phrase from the 
difference between the start PTS and stop PTS for the 
sub-picture data. [ 

■■ 'i Further, the buffer control/STC control section 57 
outputs the input clock to the video buffer section 59 
when packet data of the video data is sent to the video 
buffer section 59 from the system processor section 54, 
outputs the input clock to the audio buffer section 61 
when the packet data of the audio data is sent to the 
audio buffer section 61 from the system processor sec- 
tion 54, and outputs the input clock to the sub-picture 
buffer section 63 when the packet data of the sub-pic- 
ture data Is sent to the; sub-picture buffer section 63 
from the system processor section 54. 

i As a result, the video buffer section 59. audio buffer 
section 61 and sub-picture buffer section 63 store the 
supplied data in response to the input clock as indicated 
in step 874/ : } 

\ When the STC in the STC timer 57a matches with 
tte DTS of the video data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the video 
buffer section 59. When the STC in the STC timer 58a 
in the video decoder section 58 matches with the DTS in 
the register 58b. the decoder 58f starts decoding based 
on the butput of the comparator 58d. i 

• Consequently, the video data output from the video 
buffer section 59 in accordance with the output clock is 
decoded by the decoder 58f as indicated in step S75. 

: As is apparent from step S76, when the STC in the 
STC timer 58a in the video decoder section 58 matches 
with the PTS in the register 58c, the decoded output of 
the decoder 58f is sent to the video D/A section 66 via 
the mixing section 64 based on the output from the com- 
parator 58e. , . j 

« when the STC in the STC timer 57a matches with 
the PTS in the audio data, the buffer control/STC control 
section 57 outputs one unit of output clocks to the audio 
buffer section 61. When the STC in the STC timer 60a 
in the audio decoder section 60 matches with the PTS in 
the register 60b, the decoder 60d also starts decoding 
based on the butput of the comparator 60c. 

r Consequently, as indicated in step S77, the audio 
data output from the audio buffer section 61 in accord- 
ance with the output clock is decoded by the decoder 
60d and the decoded output is then sent to the audio 
D/A section 68. ; I 

After a predetermined time has passed, i.e., when 
the computed delay time Td elapses after the matching 
of the STC in the STC timer 57a with the start PTS of 
the sub-picture data, the buffer control/STC control sec- 
tion 57 outputs one unit of output clocks to the sub-pic- 
ture buffer section 63. When the STC in the STC timer 
"62a in the sub-picture decoder section 62 matches with 
the start PTS delayed by the delay time Td in the regis- 
ter 62b, the decoder 62f starts decoding based on the 
output of the comparator 62d. 

* Consequently, as Indicated, in step S78, the sub- 
picture data output from the sub-picture buffer section 
'a- - . i 



' 63 in accordance with the output clock is decoded by 
the decoder 62f and the decoded output is then mixed 
with the video data in the mixing section 64. The result- 
ant data is then sent to the video D/A section 66. 
5 At this time, the buffer control/STC control section 
57 supplies a stop signal to the STC timer 58a in the 
video decoder section 58 and the STC timer 60a in the 
audio decoder section 60. Consequently, decoding by 
the decoder 58f and decoding by the decoder 60d stop 
10 and the video image on the screen when the decoding 
operations are stopped is displayed on the monitor sec- 
tion 6 with no sounds generated. 

When the STC In the STC timer 62a in the sub-pic- 
ture decoder section 62 matches with the stop PTS 
15 delayed by the delay time Td in the register 62c. the 
decoder 62f stops decoding based on the output of the 
comparator 62e. 

At this time, the buffer controt/STC control section 
57 sets the time leading by the delay time Td from the 

20 STC corresponding to the start PTS, delayed by the 
delaytimeTdJntheSTCttmer58ainthevideodecoder 

section 58 and the STC timer 60a in the audio decoder 
section 60. As a result, the decoders 58f and 60d restart 
decoding. 

25 Accordingly, as indicated in step S79, the decoder 
62f in the sub-picture decoder section 62 stops output- 
ting me decoded data, and the decoded output of the 
decoder 58f is supplied to the video D/A section 66 via 
the mixing section 64 while the decoded output of the 
30 decoder 60d is supplied to the audio D/A section 68. 

Consequently, the image corresponding to the 
video data is displayed on the monitor section 6 and the 
voice corresponding to the audio data is reproduced 
from the speaker section 8. After a predetermined time 
35 delay corresponding to one phrase, the mixed image 
corresponding to the sub-picture data and video data is 
displayed on the monitor section 6. At this time, the 
video and audio data are frozen. Thereafter, the sub- 
picture data will disappear and the video and audio data 
40 are reproduced from that time. 

At the first timing, therefore, the Image of a teacher 
saying "ONE" Is displayed as the main picture on the 
monitor section 6 and the teacher's voice "ONE" is 
reproduced from the speaker section 8. as shown in 
45 FIG. 51 A. At the next timing, as shown in FIG. 51 B. the 
image of the teacher having said "ONE" and the super- 
imposition "ONE" as the sub-picture are displayed in the 
superimposing manner on the monitor section 6; At this 
timing, an apprentice as a listener should pronounce the 
so word. At the next timing, as shown in FIG. 51 C. the 
Image of the teacher saying "GOOD" is displayed as the 
main picture oh the monitor section 6 and the teacher's 
voice "GOOD" is reproduced from the speaker section 
8. 

55 As a result, at the time of learning a language, a 
student can make a pronunciation while referring to the 
superimposition after the pronunciation by the teacher. 

As shown In FIGS. 52A-52C. the superimposition 
as a sub-picture may be displayed previously, the main 
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picture and sound may be frozen for the display period 
of this sub-picture, and the main picture and sound may 
be reproduced after the display of the sU>-picture is 
completed. j j • 

First at the first timing, the picture of the teacher is 
displayed on the monitor section 6 as the main picture 
as shown in FIG. 52A. At the next timing, the image of 
the teacher still on the screen as the main picture and 
the superimposition "TWO" as the sub-picture are 
superimposed on the monitor section 6 as shown in 
FIG. 52B. At this timing, an apprentice as a listener is 
expected to make a pronunciation. At the next timing, 
the image of the teacher saying "TWO* is displayed on 
the monitor section 6 and the teacher's voice TWO" is 
reproduced from the speaker section 8, as shown in 
FIG.52C. " | 

In this case, the delay times for the main picture and 
sound may be set from the menu and delaying may be 
executed accordingly, or delaying may be done by the 
time specified by the 6tart PTS and stop PTS for the 
sub-picture unit. j [ . j 

As shown in FIGS. 53A-53C,:the sound for only the 
phrase portion may be delayed and then reproduced, 
the main picture and the superimposition as the sub- 
picture may be frozen for the playback period of this 
sound, and the main picture and sound may be repro- 
duced after the sound reproduction is completed, j 

First at the first timing, the picture of the teacher as 
the main picture p.nd the superimposition "THREE" as 
the sub-picture are siperimposeld on the monitor sec- 
tion 6 as shown in FIG. 53A. At this timing, the appren- 
tice as a listener is expected to make a pronunciation. At 
the next timing, the image of the teacher pronouncing 
THREE" is displayed on the monitor section 6 and the 
teacher's voice THREE" is reproduced from the 
speaker section 8, as shown in FIG. 53& At the next 
timing, as shown in FIG. 54C, the image of the teacher 
saying "GOOD" as the main picture is displayed on the 
monitor section 6 and the teacher's voice "GOOD* is 
reproduced from the speaker section 8. f 

In this case, the delay times for the main picture and 
sound may be set from the menu and delaying may be 
executed accordingly, or delaying may be done by the 
time specified by the start PTS and stop PTS for the 
sub-picture unit, as the phrase period. 

As shown in FIGS. 54A-54C, when the first sound 
and second sound are present in addition to the main 
picture and sub-picture, the second sound may be 
reproduced with a delay, the main picture, the superim- 
position as the sub-picture and the first sound may be 
frozen for the playback period of the second sound, and 
the main picture, the sub-picture and the first sound 
may be reproduced after the reproduction of the second 
sound is completed. ( : 

At the first timing, the image of the teacher saying 
"FOUR" as the main picture and the superimposition 
"FOUR" as the sub-picture are Isuperimposed on the 
monitor section 6, and the first Voice "FOUR" by the 
teacher is reproduced from the speaker section 8, as 



shown in FIG. 54A. At the next timing, as shewn in FIG. 
54B, the image of the teaching having said "FOUR" as 
the main picture is kept displayed on the monitor section 
6, and the second voice "VON* (in Japanese) by the 

5 teacher is reproduced from the speaker section 8. At 
this timing, an apprentice as a listener can know the 
translation of the English wad. At the next timing, as 
shown in FIG. 54C, the image of the teacher saying 
"GOOD" as the main picture is displayed on the monitor 

10 section 6 and the teachers first voice "GOOD" is repro- 
duced from the speaker section 8. 

As a result, the student can listen to the translation 
of the conversation at the delayed timing at the time of 
learning the language. j 

is In this case, the delay times of the main picture, 
sub-picture and the first sound may be set from the 
menu, or delaying may be done by the time specified by 
the start PTS and step PTS for the sub-picture unit 
As shown In FIGS. 5SA-55C. when the first sound 

20 and second sound are present in addition to the main 
picture and sub-picture, the first sound and the superim- 
position as the sub-picture may be reproduced with a 
certain delay, the main picture and the second sound 
may be frozen for the playback period of the first sound 

25 and the sub-picture, and the main picture and the sec- 
ond sound may be reproduced after the reproduction of 
the first sound and sub-picture is conpleted. 1 

At the first timing, as shown in FIG. 55A, the image 
of the teacher saying "GO" {in Japanese) as the main 

30 picture is displayed on the monitor section 6. and the 
second voice "GO" by the teacher is reproduced from 
the speaker section 8. At the next timing, as shown in 
FIG. 55B, the image of the teaching having said "GO" as 
the main picture and the superimposition "FIVE" as the 

35 sub-picture are superimposed on the monitor section 6. 
and the first voice "FIVE" by the teacher is reproduced 
from the speaker section 8. At this timing, an apprentice 
as a listener can know the translation of the Engtish 
word. At the next timing, as shown in FIG. 55C. the 

40 image of the teacher saying "GOOD" as the main pic- 
ture is displayed on the monitor section 6 and the 
teachers first voice •GOOD" is reproduced from the 
speaker section 8. 

As a result, the student can listen to the translation 

45 of the conversation at the delayed timing at the time of 
learning the language. 

In this case, the delay times of the first sound and 
the sub-picture may be set from the menu, or delaying 
may be done by the time specified by the start PTS and 

so stop PTS for the sub-picture unit 

As shown in FJGS. 56A-56C, when the first sub-pic- 
ture and second sub-picture are present in addition to 
the main picture and sound, the second sub-picture 
may be reproduced with a certain delay, the main pic- 

55 ture and sound may be frozen for the playback period of 
the second sub-picture, and the main picture and sound 
may be reproduced after the reproduction of the second 
sub-picture is completed. 
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i At the first timing, as shown in FIG. 56A, the image 
of the teachersaying "SIX* as the main picture and the 
superimposition "SIX" as the first sub-picture are super- 
imposed on the monitor Section 6, and the teacher's 
voice "SIX" is reproduced from the speaker section 8. At s 
the next timing, as shown in FIG. 56B, the image of the 
teaching having said "SIX" as the main picture and the 
superimposition "ROKU":(in Japanese) as the second . 
sub-picture or translation are superimposed on the 
monitor section 6. At this timing, an apprentice as a lis- - io 
tener can know the translation of the English worcl. At \\ 
the next timing, as shown in FIG. 56C, the image oJ the 
teacher saying "GOOD" as the main picture is displayed 
on : the monitor section 6 and the teacher's voice 
"GOOD 9 is reproduced from the speaker section 8. is 

S As a result, the student can listen to the translation 
of the conversation at the delayed timing at the time of 
learning the languages r 

: In this case, the delay time of the second sub-pic- 
ture maiy be set from the menu, or delaying may be so 
done by the time specified by the start PTS and stop 
PTS tor the siib-picture unit of the second sub-picture. 
: : Alternatively, the first and second sub-pictures may 
be displayed simultaneously, in which case separate 
display positions should be set for the first and second 25 
sub-pictures or the display colors should be changed for 
the distinction. ■ j ' 

; Instead of delaying isub-picture data, the sub-pic- 
ture data may be displayed as if hidden by a mosaic or 
black filling for the delay time. so 

i In this case, as shown in FIG. 57, a digital signal , 
processor (DSP) 65 which selectively turns the sub-pic- 
ture data from the sub-picture decoder section 62 into a 
mosaic pattern or painting the data with black is pro- 
vided between the sub-picture decoder section 62 and 35 
the mixing section 64 in the structure in FIG. 1 . 

; . In the case where ah 8 x 8 dot mosaic is to be gen- 
erated, this DSP 65 comprises a first sample and hold 
section for sampling and holding data input dot by dot, a 
first line memory for storing the output of the first sam- 40 
pie and hold section, a second sample and hold section : 
for sampling and holding the output of the first line mem- 
ory for one line, a secorid line memory for storing one 
line of data from the second sample and hold section, a 
first frequency divider if or sending a timing signal,, as 
obtained by dividing the horizontal dot clock by 8, to the ' 
first sample and hold section, and a second frequency 
divider for sending a timing 6lgnal, obtained by dividing 
the vertical sync signal by 8, to the second sample and 
hold section. j 50 

At the first timing, as shown in FIG. 58A, the image 
of the teacher saying "ELEVEN" as the main picture and 
the superimposition "ELEVEN" as the sub-picture which 
has been turned to a mosaic pattern by the DSP 65 are 
superimposed on the : monitor section 6, and the ss 
teacher's voice "ELEVEN" is reproduced from the 
speaker section 8. At the next timing, as shown in FIG.- 
58B, the Image of the teacher saying "GOOD" and the 
superimposition "ELEVEN" as the sub-picture are 

'1 : : -: ; ! . ' • ; ' , 



superimposed on the monitor section 6 and the 
teachers voice "GOOD" is reproduced from the speaker 

8. . 

The reproduction of the no-sound period between 
phrases may be skipped. 

A special reproduction, such as a strobe effect or 
afterimage effect, may be accomplished by performing 
predetermined data processing on the main picture 
data, delayed in the above-described manner, and com- 
bining the processed main picture data with main pic- 
ture with the zero delay time. 

Next, the video data in the logic formats shown in 
FIGS. 4 to 31 , a method of recording data on the optical 
disk 10 to reproduce the video data, and a recording 
system to which the recording method is applied will be 
explained with reference to FIGS. 59 to 64. 

FIG. 59 shows an encoder system that creates a 
video file of a title set 64 in which the video data is 
encoded. In the system of FIG. 59. for example, a vide- 
otape recorder (VTR) 201, an audiotape recorder (ATR) 
202, and a sub-picture source 203 are used as sources 
of the main video data, the audio data, and the sup-pic- 
ture data. Under the control of a system controller (Sys 
con) 205, they create the main video data, audio data, 
and sup-picture data, which are supplied to a video 
encoder (VENC) 206, an audio encoder (AENC) 207, 
and a sub-picture encoder (SPENC) 208. respectively. 
Under the control of the system controller (Sys con) 
205, these encoders 206, 207, and 208 perform A/D 
conversion of the main video data, audio data, and sup- 
picture data and encode them by the respective com- 
pression schemes. The encoded main video data, audio 
data, and sub-picture data (Comp Video, Comp Audio. 
Comp Sub-pict) are stored in memories 210. 21 1, and 
212. The main video data, audio data, and sub-picture 
data (Comp Video, Comp Audio, Comp Sub-pict) are 
outputted to a file formatter (FFMT) 214 under the con- 
trol of the system controller (Sys con) 205, which con- 
verts them so that they may have a file structure of video 
data for the system as explained earlier. Then, under 
the control of the system controller (Sys con) 205, the 
setting conditions for each data Item and the manage- 
ment information including attributes are stored in a 
memory 21 6 In the form of files. 

Explained next will be a standard flow of an encod- 
ing process in the system controller (Sys con) 205 that 
creates a file from video data. 

According to the flow of FIG. 60. the main video 
data and the audio data are encoded and the encoded 
main video data and audio data (Comp Video, Comp 
Audio) are supplied. Specifically, when the encoding 
process Is started, as shown in step S70 of FIG. 60, the 
parameters necessary for encoding the main video data 
and audio data are set Part of the set parameters are 
6tored in the system controller (Sys con) 205 and at the 
same time, are used at the file formatter (FFMT) 21 4. As 
shown in step S271 , the main video data is pre-encoded 
using the parameters and the optimum distribution of 
the amount of codes Is calculated. Then, on the basis of 
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the code amount distribution obtained in the pre-encod- 
ing, the main video data is encoded as 6hown in step 
S272. At the same time, the audio data is also encoded 
at step S272. As shown in step in S273. if necessary, 
the main video data is partially encoded again and the 
reencoded portion of the main video data is replaced 
with the old one. Through the series of steps, the main 
video data and audio data are encoded. Furthermore, 
as shown in steps S274 and S275. the sub-picture data 
is encoded and the encoded sub-picture data {Comp 
Sub-pict) is supplied. Namely, the parameters neces- 
sary for encoding the sub-picturedata is set. As shown 
in step S274, part of the parameters are stored in the 
system controller {Sys con) 205 and used in the file for- 
matter (FFMT) 214. On the basis of the parameters, the 
sub-picture data is encoded. By the process, the sup- 
picture data is encoded. | • | 

According to the flow of FIG/61 , the encoded main 
video data, audio data, and sup-picture" data (Com 
Video, Com Audio, Comp Sub-pict) are mixed and con- 
verted 60 as to form a video data title set structure as 
explained in FIGS. 4 and 12. Specifically, as shown in 
step S276. a cell is set as the smallest unit of the video 
data and cell playback information on a cell {C_PBI) is 
created. Then, as shown in step S277, the structure of 
the cells constituting a program chain and the main 
video, sub-picture, and audio attributes (the information 
obtained in encoding the respective data items are used 
part of these attributes) are set and the video title set 
information management table information (VTSI_MAT) 
98 containing information on a program chain and a 
video title set time search map table (VTS_MAPT) 142 
are created. At this time, as the need arises, a video title 
set direct access pointer table (VTSJ3APT) is also cre- 
ated. The encoded main video data, audio data, and 
sup-picture data (Com Video, Comp Audio, Comp Sup- 
pict) are subdivided into specific packs. An NV pack is 
placed at the head of each VOBU unit so that playback 
can be effected in the order of time code of each data 
item. With the NV packs arranged this way, each data 
cell is positioned so that a video object (VOB) may be 
composed of a plurality of cells as shown in FIG. 6. A 
set of such video objects is formatted into the title set 
structure. : i I 

Time stamps like PTS and DTS are descrbed in 
eachpack • ' 

According to the first embodiment, described in the 
PTS of a sub-picture, for example, is a time arbitrarily 
delayed from the PTS of main picture data or audio data 
which is to be reproduced in the same time slot as the 
sub-picture. j 

According to the second and other embodiments, 
the same time as described in the PTS of main picture 
data or audio data which is to be reproduced in the 
same time slot is described in the PTS of a sub-picture. 

In the flow of FIG. 61 , the program chain informa- 
tion (PGI) is obtained in the process of step S277 by 
using the database in the system controller (Sys con) 
205 or entering data again as the need arises. 



FIG. 62 shows a disk formatter system that records 
on an optical disk the title set formatted as descrtoed 
above. In the disk formatter system of FIG. 48. the 
memories 220, 222 in which the created title set b . 
5 stored supply these file data Hems to a volume formatter 
(VFMT) 226. In the volume formatter (VFMT) 225 
extracts the management information from the title sets 
84, 86, produces a video manager 71. and create the 
logic data to be recorded on the disk 10 in the arrange- 
io ment of FIG. 4. A disk formatter (DFMT) 228 adds error 
correction data to the logic data created at the volume 
formatter (VFMT) 226. thereby reconverting the fog* 
data into physical data to be recorded on the disk. A 
modulator 230 converts the physical data created at the 
t5 disk formatter (DFMT) 228 into the recording data to be 
recorded actually on the dick. Then, a recorder 232 
records the modulated recording data on the disk 10. 

A starxlard flow for creating the aforementioned 
disk win be described with reference to FIGS, 63 and 
20 64. FIG. 63 shows the ftow for creating the logic data to 
be recorded on the disk 10. Specifically, as shown in 
step S230. parameter data Hems, induding the number 
of video data files, their arrangement, and the siie of 
each video data file, are set first. Next, in step S281 
25 video manger 71 is generated from the parameters set 
and the video title set information 281 of each video title 
set 72. In step S282, the video manager 71 and the 
video tile set 71 are arranged in the order mentioned, 
according to their logic block numbers, thereby general* 
30 ing logic data which is to be recorded on the disk 1 0. 

Thereafter, the flow for creating the physical data to 
be recorded on the disk as shown in FIG. 64 is exe- 
cuted. Specifically, as shown in step S283. the bgfc 
data is divided into units of a specific number of bytes. 
55 thereby forming error correction data. Next, as shown h 
step S284, the logic data divided into units of a specific 
number of bytes are mixed with the created error correc- 
tion data to form physical sectors. Thereafter, as shown 
in step S285, physical data ts created by combining 
40 physical sectors. In this way, the modulating process 
based on certain rules Is performed on the physical data 
created in the ftow of FIG. 64, thereby forming the 
recording data. Thereafter, the recording data is 
recorded on the disk 10. ■! 
: 45 The above-descrtoed data structure can be applied 
not only to a case where the data ts recorded on record- 
ing mediums, such as optical diste. and then the cfiste 
are distributed to the users, but also to a commumcation 
system as shown in FIG. 65. Specifically, according to 
so the procedure shown in FIGS. 59 to 62. an optica! disk 
10 inwhich a video manager 71 and video title set 72 as 
shown in FIG. 4 may be loaded into a reproducing trit 
300, from whose system CPU section 50 the encoded 
data is taken out digitally and transmitted by a modda- 
55 tor/transmitter 31 0 to the users or the cable subscribers 
by radio or via a cable. Furthermore, the encoding sys- 
tem 320 shown in FIGS. 59 and 62 may aeate the dat3 
encoded on the provider side, such as a broadcasting 
station and the encoded data may be transmitted by the 
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niodulatbr/transmitter 310 to the users or the cable sub- 
scribers by radio or via a cable. In such a communica- 
tion system, the information in the video manager 71 is 
modulated at the modulator/transmitter 310 and then 
supplied. to or is directly 1 supplied to the users free of : s 
charge. When a user is interested in the title, the modu- 
lator/transmitter 310 transmits the title set 72 at the 
users or subscriber's request by radio or via a cable. 
Under the control, of the .video manager: 71 , the video 1 
title set information 94 is first transferred and then the to 
title video object 95 in the video title set reproduced 
according to the title set information 94 is transferred. At 
this time, if necessary, the video title set menu video 
object 95 is also transmitted. The transferred data is 
received by a receiver/demodulator 400 oh the user 15 
side and is processed as encoded data at the system 
CPU section 50 of the reproducing unit on the U6er or 
subscriber side of FK3; 1 in the same manner as in the 
above-described reproducing process, whereby the 
video data is reproduced. 20 
. :; In transferring the video title set 72, the video object 
sets 95, 96 are transferred using the video object unit 85 
of FIG. 6 as a unit. At the head of the video object unit 
85, an NV pack 86 containing video playback and 
search information is arranged. Furthermore, because 25 
the NV pack contains the addresses of the video object 
units to be reproduced immediately before and after the 
video object unit 85 to which the NV pack 86 belongs, 
even if the video object unit 85 is lost during transfer for 
some reason, the video object can be reproduced relia- so 
bly on the user side by requesting the lost video object 
unit 85 ,to be transmitted again. Furthermore, even if 
transfers not carried out in the order of playback of 
video object units, because the system ROM/RAM sec- 
tion 52 on the user side holds the accurate playback 35 
information on program chains, the system CPU section 
50 can specify the order of playback referring to the 
address data In its NV pack. 

Claims:-/ ■ ' 1 j <° 

i. A recording medium characterized by comprising: 
a plurality of data units recorded thereon, 
• i which become objects to be reproduced in a time 
sequential manner, each object being reproduced 45 
i within a given time period; 

each of said data units . constituted of a 
: •;: j stream of a plurality of data packs and playback 
\ time information, 6aid data packs containing pack- 
i- ets of reproduction data inclucfing at least one of so 
:; I audio data, video data and sub-picture data; 
; V said time information (PTS) of that data unit 
i which includes a sub-picture being later by a prede-. 
termined time than time Information (PTS) of that 
data unit which includes audio data or video data; ss 
l 'i reproductiondata of said data unit inclucSng 
: said sub-picture being reproduced after reproduc- 
I • tion of reproductiondata of said data unit including 
- said audio data or video data. 
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2. A recording medium according to claim 1, charac- 
terized in that said audio data and sub-picture are . 
of a same language. 

3. A recording apparatus for recording reproduction 
: data on a recording medium (10), characterized by 

comprising: 

means for generating a plurality of data 
packs and playback time information (PTS), said 
data packs containing packets of reproduction data 
including at least one of audio data, video data and 

sub-picture data; 

means for preparing a plurality of data units 

Including playback time information (PTS) and hav- 
ing a stream of data packs to be reproduced within 
a given time period as a unit; and 

means for recording said data units on said 
* recording medium (1 0) in a time-sequentially repro- 
ducible manner, 

time information (PTS) of that data unit 
which includes a sub-picture to be reproduced 
within said given time period being later by a prede- 
termined time than time information (PTS) of that 
data unit which includes audio data or video data to 
be reproduced within said given time period. 

4. A recording apparatus according to claim 3, charac- 
terized in that said audio data and sub-picture are 
of a same language. 

5. A method of recording reproduction data on a 
recording medium (10), characterized by compris- 
ing the steps of: 

generating a plurality of data packs contain- 
ing packets of reproduction data including at least 
one of audio data, video data and sub-picture data; 

preparing a plurality of data units including 
playback time information (PTS) and having a 
stream of data packs to be reproduced within a 
given time period as a unit; and 

recording said data units on said recording 
medium (10) In a time-sequentially reproducible 
manner, 

time information (PTS) of that data unit 
which includes a sub-picture to be reproduced 
within said given time period being later by a prede- 
termined time than time information (PTS) of that 
data unit which includes audio data or video data to 
be reproduced within said given time period. 

6. A method according to claim 5, characterized in 
that said audio data and sub-picture are of a same 
language. . 

7. A reproducing apparatus for reproducing reproduc- 
tion data from a recording medium (10), character- 
ized by comprising: 

means (30, 50, 52, 54, 56) for acquiring, 
from said recording medium (10), a plurality of data 
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units recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted ; of a 
stream of a plurality of data packs and playback 5 
time information; 6aid data packs containing pack- 
ets of reproduction data including at least one of 
audio data, video data and sub-picture data, ; 

time Information (PTS) of that data' unit 
which includes a sub-picture to be reproduced 10 
within a given time period being later by a predeter- 
mined time than time information (PTS) of that data 
unit which includes audio data or video data to be 
reproduced within said given time period; and 

means for converting 6aid data unit of said 75 
acquired reproduction data to a reproduction signal 
in accordance with said time information (PTS) 
included in said data unit and reproducing said 
reproduction signal. j j 

whereby after reproduction data of that data 20 
unit which includes audio data or video data to be 
reproduced within a given itime period is repro- 
duced, said reproducing means reproduces repro- 
duction data of said data unit including said sub- 
picture to be reproduced within said given period. 25 
; j ■ . : • ! 

8. A reproducing apparatus according to claim 7. 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 
data of said data unit including video data are so 
simultaneously reproduced,' reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of 6aid data unit 
including video data are simultaneously reproduced 35 
again after reproduction of said reproduction data 

of said data unit including said sub-picture is com- 
pleted. 

9. A reproducing apparatus according' to claim 7. 40 
characterized in that when;a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 45 
including a sub-picture is Reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, so 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced; 

j ' : ; 55 

10. A reproducing apparatus (according to claim 7, 
characterized in that while reproduction data of said 
data unit including video data is being reproduced . 
at a predetermined point of time, reproduction data 



of said data unit including a sub-picture fe repro- 
duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data, both data being 
associated with that point of time, are simultane- 
ously reproduced. 

11. A reproducing apparatus according to daim 7, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultanecusry 
reproduced, reproduction data of said data unit 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

12. A reproducing apparatus according to daim 7. 
characterized in that said autio data and said suo- 
picture are of a same language. 

13. A method of reproducing reproduction data from a 
recording medium (10), characterized by compris- 
ing the steps of; 

acquiring (30, 50, 52, 54, 56). from said 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and payback 
time information (PTS). said data packs containing 
packets of reproduction data Inclucfing at least one 
of audio data, video data and sub-picture data, 

time information (PTS) of that data unit 
which includes a sub-picture to be reproduced 
within a given time period being later by a predeter- 
mined time than time information (PTS) of that data 
unit which includes audio data or video data to be 
reproduced within sad given time period; and 

converting said data unit of said reproduc- 
tion data to a reproduction signal in accordance 
with said time Information (PTS) included in said 
data unit and reproducing said reproduction signal. 

whereby after reproduction data of that data 
unit which includes audio data or video data to be 
reproduced within a given time period is repro- 
duced, reproduction data of said data unit including 
. said sub-picture to be reproduced within said given 
period is reproduced. 
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14!; A reproducing method according to claim 13. char- 
v acterized in that after reproduction data of said data 
! I unit including audio data and reproduction data of 
; ; said data unit including video data are simultane- 
• ) lously reproduced, reproduction data of said data 5 
.i unit 'including a sub-picture is reproduced, and 
{ reproduction data of said data unit including audio 

• data and reproduction data of said data unit rnclud- 
' ■ I Ing video data are . simultaneously reproduced 
. < ?' again after reproduction of said reproduction data 10 

; of said data unit including said sub-picture is com- 
: i pleted. ; | 

is! A reproducing method according to claim 13, char- 
acterized I in i. that when a predetermined time is 
I elapses after reproduction data of said data unit 
; • including audio data and reproduction data of said 
• t data unit including Video data are simultaneously 
!! reproduced, reproduction data of said data unit 
Yy including a sub-picture Is reproduced while. said so 
S reproduction data of said data unit including video 
'l data at that pant of time is kept reproduced, and 

• when reproduction of said reproduction data of said 
I data unit including said sub-picture is completed. 
) reproduction data of said data unit including audio 25 
: data and reproduction data of said data unit includ- 

i ing video data, both data being associated with that 

• point of time, are simultaneously reproduced. 

i . . : 

1 6. A reproducing method according to claim 13, char- 30 
;;• acterized in that while reproduction data of said, 
i data unit including video data is being reproduced 

: • \ at a predetermined point of time, reproduction data 

: ? of said data unit including a sub-picture is repro- 

•V duced, and when reproduction of said reproduction 35 

: > data of said data unit indudng said sub-picture is 

v completed, production data of said data unit 

• "? including audio data and reproduction data of said 
j i data unit including' video data, both date being 

associated with that point of time, are 6imultane- *o 
f i ously reproduced; £ 

17. A reproducing method according to claim 13, char- 
V acterized in that when a predetermined time 

. i \ elapses after reproduction data of said data unit 45 
\ including video data and reproduction data of said 
( data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data fe reproduced while said repro- 
I duction data of said data unit including video data at so 
■■J that point of time is kept reproduced, and when 

• reproduction of said reproduction data of said data 

• unit including said audio data is completed, repro- 
: - duction data of said data unit including audio data 

• j and reproduction data of said date unit including ss 
i video data, both data being associated with that 
I point of time, are simultaneously reproduced. 
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18. A reproducing method according to claim 13, char- 
acterized in that said audio data and said sub-pic- 
ture are of a same language. 

19. A reproducing apparatus for reproducing reproduc- 
■ . tion data from a recording medium (10), character- 
ized by comprising: 

means (30, 50, 52, 54, 56) for acquiring, 
from said recording medium (10), a plurality of data 
units recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a . 
stream of a plurality of data packs and playback 
time information (PTS). said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data; and 
means for converting said data unit of said 
acquired reproduction data to a reproduction signal 
in accordance with said time information (PTS) 
included in said data unit and reproducing said 
reproduction signal, 

whereby after reproduction data of that data 
unit which includes audio data or video data to be 
reproduced within a given time period is repro- 
duced, said reproducing means reproduces repro- 
: duction data of said data unit including said sub- 
picture to be reproduced within said given period 
when a predetermined time previously set elapses. 

20. A reproducing apparatus according to claim 19. 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 

; date of said data unit including video data are 
simultaneously reproduced, reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including video data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit Including said sub-picture Is com- 
pleted. 

21. A reproducing apparatus according to claim 19, 
characterized In that when a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 

■ '■ data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said date unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. 
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22. A reproducing apparatus according to claim 19. 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- 
duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
Including audio data and reproduction data of said 
data unit including video data, both data being 
associated with that point of time, are simultane- 
ously reproduced. 

23. A reproducing apparatus according to claim 19, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data is reproduced while 6aid repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. ! 

: i ■: ! : 

24. A reproducing apparatus according to daim 19, 
characterized in that said audio data and said sub- 
picture are of a same language. 

25. A method of reproducing reproduction data from a 
recording medium (1 0). characterized by compris- 
ing the steps of : ; | i ■ j 

acquiring (30, 50, 52, 54. 56), from said 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data; and 

converting (57, 53, 60, 62) said data unit of 
said reproduction data to a reproduction signal In 
accordance with said time information (PTS) 
included in said data unit tand reproducing said 
reproduction signal, i i 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, reproduction data of said 
data unit including said sub-picture to be repro- 
duced within said given period is reproduced when 
a predetermined time previously set etapses. j 



26. A reproducing method according to daim 25. char- 
acterized in that after reproduction data cf said data 
unit including audio data and reproduction data of 
said data unit including video data are sirruttane* 

5 ously reproduced, reproduction data of said data 
unit including a sub-picture is reproduced, and 
reproduction data of said data unit inducing audio 
data and reproduction data of sad data unit includ- 
ing video data are simultaneously reproduced 

10 again after reproduction of said reproduction data 
of said data unit including said sub-picture is com- 
pleted. 

27. A reproducing method according to daim 25, char- 
is acterized in that when a predetermined time 

elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit indudng video data are simultaneously 
reproduced, reproduction data of said data unit 

20 including a sub-picture is reproduced while said 
reproduction data of 6aid data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit inducing said sub-picture is completed, 

2$ reproduction data of said data unit inducing audio 
data and reproduction data of said data unit indud- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced 

so 28. A reproducing method accorcfng to claim 25, char- 
acterized in that while reproduction data of said 
data uiit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- 

35 duced, and when reproduction of said reproduction 
data of said data unit Including said sii>pictuf e is 
corrpleted. reproduction data of said data unit 
induding audio data and reproduction data of sad 
data unit induding video data, both data being 

40 assodated with that pdnt of time, are simultane- 
ously reproduced. 

29. A reproducing method according to daim 25. char- 
acterized in that when a predetermined time 

45 elapses after reproduction data of said data unit 
induding video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
induding audio data is reproduced while said repro- 

so duction data of said data unit induding video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data c* said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 

55 and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 
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30. ' A reproducing method according to claim 25, char- 
. 'i acterized in that said audio data and said sub-pic- 

ture are of a same language. ■ 

• : j • ... v ' 

31 . ! A reproducing apparatus for reproducing reproduc- s ■■■ 
; tion data from a recording medium (1 0). character- 

' r ized by comprising: j 

• means (30, 50, 52, 54, 56) for acquiring, 
j | from said recording medium (10), a plurality of data 
: : : units recorded thereon, which become objects to be to 
•"■ reproduced in a time sequential manner, each 

• object being reproduced within a given time period, 
. j each of said data units being constituted of a 
• ^stream of a plurality of data packs and playback 
; | time information (PTS), said data packs containing 15 

; packets of reproduction data including at least one 
of audio data, video data and sub-picture data; 
: means (4) for setting a delay time (Td) at 
;: : which reproduction 'data of that data unit which 

( includes a sub-picture to be reproduced within a 20 
, t given time period after reproduction data of that 

■ i data unit which Includes audio data or video data to 

be reproduced within said given time period is 
reproduced; and : ] ' 

v means (57, 58, 60. 62) for converting said 25 
: data unit of said acquired reproduction date to a 
reproduction signal In accordance with said time 
;'. information (PTS) included in said data unit and 
'\ reproducing said reproduction signal, 

■•; whereby after reproduction data of that data 30 
■ -v unit which includes at least one of audio data and 

■ video data to be reproduced within a given time 
^period is reproduced, said reproducing means 
j reproduces reproduction data of said data unit 

: including isaid sub-picture to be reproduced within 35 
v said given period when 6aid set delay time (Td) 
: i elapses.- ' . j 

.••*'' ' 1 

32. A reproducing apparatus according to claim 31, 

; characterized in that after reproduction data of said . 40 
: : data unit including . audio data and reproduction 

■ 5 data of said data unit including video data are ; 
\ simultaneously reproduced, reproduction data of 

\ said data unit including a sub-picture is reproduced, 
I and reproduction data of said data unit including as 
y audio data and reproduction data of said data unit 
: 1 including yideo data are simultaneously reproduced 
\. again after reproduction of said reproduction data 
of said data unit including said 6ub-picture is com- 
-,i ■ pleted. ..; 1 50 

33. A reprodudng apparatus according to claim 31, 

j- characterized in that when a predetermined time - 
: :1 : elapses after reproduction data of said data unit 
V. including audio data and reproduction data of said 55 
i data unit including video data are simultaneously 
: •. reproduced, reproduction data of said data unit 

■ V including a sub-picture is reproduced while said 

reproduction data 61 said data unit including video 
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data at that point of time Is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. 

34. A reproducing apparatus according to claim 31, 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- . 
duced. and when reproduction of said reproduction 
data of said data unit including said sub-picture is 

. completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data, both data being : 
associated with that point of time, are simultane- 
ously reproduced, 

35. A reproducing apparatus according to claim 31. 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data is reproduced while said repro- 
duction data of 6aid data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 
duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are 6'imultaneousJy reproduced. 

36. A reproducing apparatus according to claim 31, 
characterized in that said audio data and said sub- 
. picture are of a same language. 

37. A reproducing apparatus according to claim 31, 
characterized in that said sub-picture is displayed 
as if hidden by a mosaic pattern or black filling for a 
delay period. . 

38. A method of reproducing reproduction data from a 
recording medium (10), characterized by compris- 
ing the steps of : . - 

aoquiring (30, 50, 52. 54, 56), from sod 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
, object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), said data packs containing 
packets of reproduction data including at least one 
. of audio data, video data and sub-picture data; 
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setting (4) a delay time (Td) at which repro- 
duction data of that data unit which includes a sub- 
picture to be reproduced within a given time period 
after reproduction data of that data unit which 
includes audio data or video data to be reproduced 
within said given time period is reproduced; and 

converting (57, 58, 60i 62) said data unit of 
said reproduction data to a reproduction signal in 
accordance with said time information (PTS) 
included In said data unit and reproducing said 
reproduction signal, | 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, reproduction data of said 
data unit including said sub-picture to be repro- 
duced within said given period is reproduced when 
said set delay time (Td) elapses. 

I : ' : 

39. A reproducing method according to claim 38, char- 
acterized in that after reproduction data of 6ald data 
unit including audio data and reproduction data of 
said data unit including video data are simultane- 
ously reproduced, reproduction data of said data 
unit including a sub-picture is reproduced, ; and 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit including said sub-picture is com- 
pleted. 



40. A reproducing method according to claim 38. char- 
acterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time Is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced, j 

■ . ; i . ; i 

41, A reproducing method according to claim 38. char- 
acterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of said data unit including a sub-picture is repro- 
duced.'and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data, both data being 



associated with that point of time, are simultane- 
ously reproduced. 

42. A reproducing method accorcfing to daim 38. ehar- 
5 acterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of sa'rf 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
w including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time te kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is complied, repro- 
is duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

so 43. A reproducing method accorcfing to daim 38. char- 
acterized in that said audio data and sad sub-pic- 
ture are of a same language. 

44. A reproducing method accorcfing to claim 38. char- 
ts acterized in that said sub-picture is displayed as if 

hidden by a mosaic pattern or black filling for a 
delay period. 

45. A reproducing apparatus for reproducing reproduc- 
so tion data from a recording medium (1 0). character- 
ized by comprising: ! 

means (30. 50, 52. 54, 56) tor acquiring, 
from said recording medium (1 0), a plurality of data 
wiits recorded thereon, which become objects to be 

35 reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), said data packs containing 

40 packets of reproduction data inducing at least one 
of audk) data, video data and sub-picture data, 

said time information (PTS) of that data unit 
which indudes a sub-picture consisting of a play- 
back start time (PTS) and playback stop time 

45 (PTS); 

means (57) for computing a delay time of 
said data unit induding said sub-picture from said 
playback start time (PTS) and playback stop time 
(PTS) recorded in said data unit including said sub- 
so picture of said acquired reproduction data; and 

means (57. 58. 60. 62) tor converting sad 
data unit of said acquired reproduction data to a 
reproduction signal in accordance with sad time 
information (PTS) induded in said data uvt and 
55 reproducing said reproduction signal, 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 
video data to be reproduced within a given time 
period is reproduced, said reproducing means 
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reproduces reproduction data of said data unit 

• including said sub-picture to be reproduced within 
' ; said given period when said computed delay time 
'.. : elapses. 1 

- y : . \ •/. ; 

46. ; A reproducing apparatus according to daim 45, 
: characterized in that after reproduction data of said 
: data unit including audio data and reproduction 

..: ; data of said data unit including video data are 
'": simultaneously reproduced, reproduction data of io 
: ^ said data unit including a sub-picture is reproduced, 
: • and reproduction data of said data unit including 
; audio data and reproduction data of said data unit 
J Including video data are simultaneously reproduced 
: again after reproduction of said reproduction data 75 
i of said data unit including said sub-picture is com- 
peted V 1. 

. / ■ !- • S 

47. A reproducing apparatus according to claim 45, 

; characterized in that when a predetermined time 20 = 

; elapses after reproduction data of 6aid data unit 
: \ including audio data and reproduction data of said 

i data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 

■ including a sub-picture is reproduced while said 25 
; \ reproduction data of said data unit including video 

■ ; data at that point of time is kept reproduced, and 

■ j when reproduction of said reproduction data of said 

■ ; data unit including said sub-picture is completed, 

j - reproduction data of said data unit including audio 30 

• • data and reproduction data of said data unit includ- 
. :' % ing video data, both data being associated with that 

: ; point of time, are simultaneously reproduced. 



48; A reproducing apparatus according to claim 45, 3s 
: characterized in that while reproduction data of said 
r data unit including video data is being reproduced 
j :; at a predetermined point of time, reproduction data 
t. of said data unit including a 6ub-picture is repro- 
■J duced, and when reproduction of said reproduction 40 
data of said data unit Including said sub-picture is 
; completed, reprodubtion data of said data unit 
■} including audio data and reproduction data of said ; 
• v data unit including j video data, both data being 
j associated with that point of time, are simuKane- 45 
' ^ ously reproduced/ |. . 

49, A reproducing apparatus according to claim 45, 
•V characterized in that when a predetermined time 
•; elapses after reproduction data of said data unit so 
; including video data and reproduction data of said 
i data unit including a sub-picture are simultaneously 

reproduced, reproduction data of said data unit 
- including audio data is reproduced while said repro- . 
; : duction data of said data unit including video data at ss 

that point of time is kept reproduced, and when 
: ; :! reproduction of said reproduction data of said data 

unit including said audio data is completed, repro- 
i duction data of said data unit including audio data 



and reproduction data of said data unit including ' 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

50. A reproducing apparatus according to daim 45, 
characterized in that said audio data and said sub- 
picture are of a same language. 

51. A reproducing apparatus according to claim 45, 
characterized in that said 6ub-picture is displayed 
as if hidden by a mosaic pattern or black f iliing for a 
delay period. 

52. A method of reproducing reproduction data from a 
recording medium (10), characterized by compris- 
ing the steps of: 

acquiring (30, 50, 52, 54, 56), from said 
recording medium (10), a plurality of data units 
recorded thereon, which become objects to be 
reproduced in a time sequential manner, each 
object being reproduced within a given time period, 
each of said data units being constituted of a 
stream of a plurality of data packs and playback 
time information (PTS), said data packs containing 
packets of reproduction data including at least one 
of audio data, video data and sub-picture data. 

computing (57) a delay time (Td) at which 
reproduction data of said data unit including said 
sub-picture from a playback start time (PTS) and 
playback stop time (PTS) recorded in said data unit 
including said si±>-picture of acqiired reproduction 
data;and 

converting (57, 58, 60, 62) said data unit of 
said reproduction data to a reproduction signal in 
accordance with said time information (PTS) 
included in said data unit and reproducing said 
reproduction signal, 

whereby after reproduction data of that data 
unit which includes at least one of audio data and 
•! video data to be reproduced within a given time 
period is reproduced, reproduction data of said 
data unit Including said sub-picture to be repro- 
duced within said given period is reproduced when 
said computed delay time elapses. 

53. A reproducing method according to claim 52, char- 
,. acterized in that after reproduction data of said data 
unit including audio data and reproduction data of 
said data unit including video data are simultane- 
ously reproduced, reproduction data of said data 
unit including a sub-picture is reproduced, and 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data are simultaneously reproduced 
. again after reproduction of said reproduction data 
of said data unit including said sub-picture is com- 
, pleted. . . 
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54. A reproducing method according to claim 52, char- 
acterized in that when a' predetermined ;time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said ■ 
data unit including video data are simultaneously s 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said w 
data unit including said sub-picture Is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced, i 13 

55. A reproducing method according to claim 52, char* : 
acterized in that while reproduction data of said 
data unit including video data is being reproduced 

at a predetermined point of time, reproduction data 20 
of said data unit including a sub-picture is repro- 
duced, and when reproduction of said reproduction 
data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 25 
data unit including video data, both data being ; 
associated with that point of time, are simultane- 
ously reproduced. ! ; 

1 . . . ■ : 

56. A reproducing method according to claim 52/ char- 30 
acterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 35 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 40 
duction data of said data unit Including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

. I: ! 45 

57. A reproducing method according to claim 52, char- 
acterized in that said audio data and said sub-pic- 
ture are of a same language. 

58. A reproducing method according to claim 52, char- so 
acterized in that said sub-picture is displayed as H 
hidden by a mosaic pattern or black filling for a 
delay period. 1 !•..•'• 

• ! • ■ 

59. A reproducing apparatus characterized by compris- 
ing: 1 . ■ i 

reading means (30, 50, 52, 54, 56) for read- 
ing a main picture data unit consisting of a stream 
of packs of at least one ma n picture data for repro- 
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during a main picture, an audio data unit consisting 
of a stream of packs of at least one audio data 
reproducible in a same time slot as said main pic- 
ture data unit, ard a sub-picture data unit consisting 
of a stream of packs of at least one sib-picture data 
reproducible after a predetermined time after repro- 
duction of at least one of said main picture data unit 
and said audio data unit; 

first control means (57. 58. 60) for converting 
at least one of said main picture data unit and audio 
data unit read by said reading means (30. 50. 52. 
54, 56). to a reproduction output; and 

second control means (57, 62) for converting 
saW sub-picture data unit, read by said reading 
means (30. 50, 52, 54, 56). to a reproduction output 
after conversion of at least one of said main picture 
data unit and audio data unit to sad reproduction 
output by said fkst control means (57, 58, 60). 

60. A reproducing apparatus according to daim 59. 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 
data of said data unit including video data are 
simultaneously reproduced, reproduction data of 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including video data are simultaneously reproduced 
again after reproduction of said reproduction data 
of said data unit including said sub-picture is com- 
pleted. 

61. A reproducing apparatus according to darm 59. 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
induding audio data and reproduction data of said 
data unit induding video data are simultanecusly 
reproduced, reproduction data of said data unit 
inducing a sub-picture is reproduced while sad 
reproduction data of sad data unit induding video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit inciucfing sad sub-picture is completed, 
reproduction data of sad data unit inducing audio 
data and reproduction data of sad data unit indud- 
ing vdeo data, both data being associated with that 
point of time, are simultaneously reproduced. 

62. A reprodudng apparatus according to daim 59, 
characterized in that while reproduction data of sad 
data unit induding vdeo data is being reproduced 
at a predetermined point erf time, reproduction data 
of sad data urit induding a sub-picture is repro- 
duced, and when reproduction of sad reproduction 
data of sad data unit induding sad sub-picture is 
conpleted, reproduction data of sad data unit 
induding audio data and reproduction data of sad 
data unit induding vdeo data, both data being 
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' I associated with that point of time, are simultane- ; 
ously reproduced. 

63. A reproducing apparatus according to claim 59, 

v f characterized in that when a predetermined time s 
■v elapses after reproduction data of said data unit . 
; : : ; including video data and reproduction data of said 
. i data unit including a "sub-picture are simultaneously 
: reproduced, reproduction data of said data unit 
v : including audio data is reproduced while said repro- to 
! v duction data of said data unit including video data at 
• v that point of time is kept reproduced, and when 
: ) reproduction of said reproduction data of said data 
; \ unit including said audio data is completed, repro- 
t duction data of said data unit including audio data ! is 
'■ [ and reproduction data of said data unit including 
•] video data, both data being associated with that 
?■ point of time, are simultaneously reproduced. 
/ . .: ' .; |. 

64. A reproducing apparatus according to claim 59, so 
characterized in that 6aid audio data and said sub- 
picture are of a same language. 

: i • : . ■ ; ; j . • . * - - 

65. A reproducing apparatus characterized by compris- 

S ing:/ ' ': [' ' ■ 25 

v reading means (30. 50, 52. 54, 56) for read- 

■ ing bl main picture data unit consisting of a stream 
[ of packs of at least one main picture data for repro- 

l ). ducing a main picture, an audio data unit consisting . 

■ '■■ of a stream of packs of at least one audio data 30 
•I reproducible in a salme time slot as said main pic- 
! ture data unit, and a sub-picture data unit consisting 
I of a stream of packs of at least one sub-picture data 
? reproducible in said same time slot as said main 

" i; picture data unit; | 55 
first control means (57, 58, 60) for converting 
\ at least one of said main picture data unit and audio 
I data unit read by said reading means (30, 50, 52, 

: i 54, 56), to a reproduction output; and 

\ i second control means (57, 62) for converting 40 
y 6aid sub-picture data unit, read by said reading 

; ; means (30, 50, 52, 54, 56), to a reproduction output 
} when a predetermined time previously set elapses 
} after conversion of at least one of 6aid main picture 

> j; data unit and audio data unit to said reproduction • 4S 

. ■;' output by said first control means (57, 58, 60). 

(B6. A reproducing apparatus according to claim 65, 
7 characterized in that after reproduction data of said 

■ data unit Including atidio data and reproduction so 
T data of said data ;unrt including video data are 

v2 simultaneously reproduced, reproduction data of 

; said data unit including a sub-picture is reproduced. 

? and reproduction data of said data unit including 
audio data and reproduction data of said data unit ss 

• : t including video data are simultaneously reproduced 

: i again after reproduction of said reproduction data 

I of said data unit including said sub-picture is com- 

: ; : j plated.;' : f 



67. A reproducing apparatus according to claim 65, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio 
data and reproduction data of said data unit includ- 
ing video data, both data being associated with that 
point of time, are simultaneously reproduced. 

68. A reproducing apparatus according to claim 65, 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 
at a predetermined point of time, reproduction data 
of 6aid data unit including a sub-picture is repro- 
duced, and when reproduction of said reproduction 
. data of said data unit including said sub-picture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit including video data, both data being 
associated with that point of time, are simultane- 
ously reproduced. 

69. A reproducing apparatus according to claim 65, 
characterized in that when a predetermined time 

. elapses after reproduction data of said data unit 
including video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
including audio data is reproduced while said repro- 
duction data of said data unit including video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of said data 
unit including said audio data is completed, repro- 

' duction data of said data unit including audio data 
and reproduction data of said data unit including 
video data, both data being associated with that 
point of time, are simultaneously reproduced. 

70. A reproducing apparatus according to claim 65, 
characterized in that said audio data and said sub- 
picture are of a same language. 

71. A reproducing apparatus characterized by compris- 
ing: 

reading means (30, 50, 52, 54, 56) for read- 
ing a main picture data unit consisting of a stream 
of packs of at least one main picture data for repro- 
: ducing a main picture, an audio data unit consisting 
of a stream of packs of at least one audio data 
reproducible in a same time slot as said main pic- 
ture data unit, and a sub-picture data unit consisting 
of a stream of packs of at least one 6Ub-picture data 
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reproducible after a predetermined time after repro- 
duction of at least one of said main picture data unit 
and said audio data unit; | 

setting means (4) for; setting a delay time 
(Td) at which said sub-picture data unit is repro- 5 
duced after reproduction of at least one of said 
main picture data unit and audio data unit; 

f irst control means (57. 58. 60) for converting / 
at least one of said main picture data unit and audio : 
data unit, read by said reading means (30. 50, 52. w 
54. 56). to a reproduction output; and ; j 

second control means (57, 62) for converting 
said sub-picture data unit, read by said reading 
means (30. 50. 52, 54. 56). to a reproduction output \ 
when said delay time (Td) set by said setting means t s 
(4) elapses after conversion of at least one of said 
main picture data unit and audio data unit to said 
reproduction output by said first control means (57. 
62). 

■ 20 

72. A reproducing apparatus according to daim 71, : 
characterized in that after reproduction data of said 
data unit including audio data and reproduction 
data of said data unit including video data are : 
simultaneously reproduced, reproduction data of 25 
said data unit including a sub-picture is reproduced, 
and reproduction data of said data unit including 
audio data and reproduction data of said data unit 
including video data are simultaneously reproduced 
again after reproduction of said reproduction data so 
of said data unit including said subpictuTe is com- 
pleted. 

73. A reproducing apparatus according to daim 71, : 
characterized in that when a predetermined time 35 
elapses after reproduction data of said data unit 
including audio data and reproduction data of said 
data unit inducing video data are simultaneously 
reproduced, reproduction data of said data unit 
including a sub-picture is reproduced while said 40 
reproduction data of said data unit including video 
data at that point of time is kept reproduced, and 
when reproduction of said reproduction data of said 
data unit including said sub-picture is completed, 
reproduction data of said data unit including audio *s 
data and reproduction data of said data unit includ- 
ing video data, both data being assodated with that 
point of time, are simultaneously reproduced. ! 

: I ! i 

74. A reprodudng apparatus according to daim 71. so 
characterized in that while reproduction data of said 
data unit including video data is being reproduced 

at a predetermined point of time, reproduction data 
of said data unit induding a 6ub-picture is repro- 
duced, and when reproduction of said reproduction ss 
data of said data unit induding said sub^icture is 
completed, reproduction data of said data unit 
including audio data and reproduction data of said 
data unit induding video data, both data bang 



assodated with that point of time, are simultane- 
ously reproduced. 

75. A reprodudng apparatus according to claim 71, 
characterized in that when a predetermined time 
elapses after reproduction data of said data unit 
induding video data and reproduction data of said 
data unit including a sub-picture are simultaneously 
reproduced, reproduction data of said data unit 
induding audio data is reproduced while said repro- 
duction data of said data unit induding video data at 
that point of time is kept reproduced, and when 
reproduction of said reproduction data of sad data 
unit including said audio data te completed, repro- 
duction data of said data unit induding audio data 
and reproduction data of said data unit induding 
video data, both data being associated with that 
point of time, are simultaneously reproduced 

76. A reproducing apparatus according to daim 71. : 
characterized in that said aucSo data and said tub- 
picture are of a same language. 

77. A reprodudng apparatus according to daim 71, 
charaderized in that sad sub-picture is dsptayed ; 
as if hidden by a mosaic pattern or black filling tor a 
delay period. 

78. A reproducing apparatus charaderized by compris- 
ing: 

reading means (30, 50, 52. 54. 56) for read- 
ing a main picture data unit consisting of a stream 
of packs of at least one main picture data for repro- 
dudng a main picture, an audio data unit consisting 
of a stream of packs of at least one aixSo dat3 
reproducible in a same true slot as said main pic- 
ture data unit and a sub-picture data unit consisting 
of a stream of packs of at least one sub-picture data 
reproducible after a predetermined time after repro- 
duction of at least one of said main picture data unit 
and said audio data unit, a playback start time 
[PIS) and playback stop time (PTS) being recorded 
in sakJ sub-picture data unit; 

means (57) for computing a delay time (Td) 
of said sub-picture data unit from said playback 
start time (PTS) and playback stop time (PTS) in 
said sub-picture data unit, read by said reading 
means (30. 50, 52, 54. 56); 

first control means (57, 58, 60) for converting 
at least one of said main picture data unit and audio 
data unit read by said reading means (30, 50. 52, 
54. 56), to a reproduction output; and 

second control means (57, 62) for converting 
said sub-picture data unit, read by said reading 
means (30. 50. 52. 54. 56), to a reproduction output 
when said delay time (Td) computed by sad com- 
puting means (57) elapses after conversion of at 
least one of sad main picture data unit and audio 
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.data unit to said reproduction output by said first 
';. ■] control means (57, 62). 

79. ' A reproducing apparatus according to claim 78, 
j characterized in that after reproduction data of said 
i data unit including audio data and reproduction 

M data of said data unit including video data are 
■[ v simultaneously reproduced, reproduction data of 
: said data unit including a sub-picture is reproduced, 
■ ; and reproduction data of said data unit including 

• audio data and reproduction data of said data unit 
! including video data are simultaneously reproduced 

•". ■ ■: \ again afte* reproduction of said reproduction data 
; of said data unit Including said sub-picture is com- 
pleted. ; t " 

80. ' A reproducing apparatus according to claim 78, 
: : characterized in that when a predetermined time 

I elapses after reproduction data of said data unit 

• including audio data and reproduction data of said 
i data unit including video data are simultaneously 

. I reproduced, reproduction data of said data unit 
: ; including a sub-picture is reproduced while said 
• ■ reproduction data of said data unit including video 

i data at that point of time is kept reproduced, and .' 25 
: ! I when reproduction of said reproduction data of said 
V ; - : . { data unit including said sub-picture is completed. 

• reproduction data of said data unit including audio 
■ ■ \ ' data and reproduction data of said data unit includ- 

f ing video data, both data being associated with that 
; j point of time, are simultaneously reproduced. 



video data, both data being associated with that 
point of time; are simultaneously reproduced. 

r. 83. A reproducing apparatus according to daim 78, 
5 . characterized in that said audio data and said sub- 
picture are of a same language. 

. 84. A reproducing apparatus according to claim 78, 
characterized in that said sub-picture is displayed 
10 as if hidden by a mosaic pattern or black filling for a 
delay period. 



20 
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81. A reproducing apparatus according to daim 78, 
; V characterized in that while reproduction data of said 
: : data unit induding video data is being reproduced 
• V at a predetermined point of time, reproduction data 

of said data unit including a sub-picture is repro- : 

• duced, and when reprodudion of said reproduction 
" data of said data unit induding said sub-picture is 

; completed, reproduction data of said data .unit 
: \ including audio data and reproduction data of said 
1 j data unit Including^ video data, both data being 

• associated with that point of time, are simultane- 
j ously reproduced./ j . 

82, A reprodudng apparatus according to daim 78, 
\ charaderized in that when a predetermined time 

• elapses after reproduction data of said data unit 
I including video data and reproduction data of said 

data unit including a sub-picture are simultaneously 
j* reproduced, reproduction data of . said data unit 
) including audio data is reproduced while said repro- 
. duction data of said data unit induding video data at 

that pbint of time is kept reproduced, and when 

■ reproduction of said reprodudion data of said data 
unit including 6aid audio data is completed, repro-. 

■ duction data of said data unit induding audio data 
i and reproduction data of said data unit including 
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